-- Logs begin at Fri 2022-08-05 09:46:36 UTC, end at Fri 2022-08-05 10:53:50 UTC. -- Aug 05 10:17:57.485246 dv-cinder-815582-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 05 10:17:57.494348 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 05 10:17:57.496389 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 10:17:57 2022] *** Aug 05 10:17:57.496389 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 10:17:57.496389 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 10:17:57.496389 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: nodename: dv-cinder-815582-15-iscsi Aug 05 10:17:57.496389 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: machine: x86_64 Aug 05 10:17:57.496389 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: clock source: unix Aug 05 10:17:57.496389 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: pcre jit disabled Aug 05 10:17:57.496389 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: detected number of CPU cores: 4 Aug 05 10:17:57.496389 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: current working directory: / Aug 05 10:17:57.496389 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: detected binary path: /usr/bin/uwsgi-core Aug 05 10:17:57.496389 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: your processes number limit is 47680 Aug 05 10:17:57.496389 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: your memory page size is 4096 bytes Aug 05 10:17:57.496389 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: detected max file descriptor number: 2048 Aug 05 10:17:57.496389 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: lock engine: pthread robust mutexes Aug 05 10:17:57.497331 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: thunder lock: enabled Aug 05 10:17:57.497331 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 05 10:17:57.497331 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 10:17:57.535149 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: Python main interpreter initialized at 0x557296ec99c0 Aug 05 10:17:57.535149 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: python threads support enabled Aug 05 10:17:57.535149 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: your server socket listen backlog is limited to 100 connections Aug 05 10:17:57.535149 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: your mercy for graceful operations on workers is 90 seconds Aug 05 10:17:57.535501 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 10:17:57.535501 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: *** Operational MODE: preforking *** Aug 05 10:17:57.535801 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: *** uWSGI is running in multiple interpreter mode *** Aug 05 10:17:57.535801 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: spawned uWSGI master process (pid: 103122) Aug 05 10:17:57.535987 dv-cinder-815582-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 05 10:17:57.539971 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: spawned uWSGI worker 1 (pid: 103123, cores: 1) Aug 05 10:17:57.539971 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: spawned uWSGI worker 2 (pid: 103124, cores: 1) Aug 05 10:17:57.539971 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 10:17:58.185318 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 10:17:58.185945 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 10:17:59.244918 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 10:17:59.244918 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: from cryptography.utils import int_from_bytes Aug 05 10:17:59.245514 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 10:17:59.245514 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: from cryptography.utils import int_from_bytes Aug 05 10:17:59.247607 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 10:17:59.247607 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: from cryptography.utils import int_from_bytes Aug 05 10:17:59.248064 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 10:17:59.248064 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: from cryptography.utils import int_from_bytes Aug 05 10:18:01.705898 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 10:18:01.706507 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 10:18:01.706645 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 10:18:01.706811 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 10:18:01.707281 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 10:18:01.707372 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 10:18:01.707472 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 10:18:01.707552 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 10:18:01.707633 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.707935 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 10:18:01.708067 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.708149 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 10:18:01.708350 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.708716 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.709048 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.709178 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.709321 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.709493 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.709651 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.709822 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.709971 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.710150 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.710254 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.710479 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.710577 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.710783 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.710873 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.711130 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-15-iscsi {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.711218 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.711446 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.711549 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.711746 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.711841 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.712007 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.712095 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.712298 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.712384 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.712607 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.712699 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-15-iscsi {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.712916 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.713007 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.713208 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.713304 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.713508 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.713689 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.713800 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.714214 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.714281 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.714389 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.714468 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.714696 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.714792 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.715039 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.715220 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.715359 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.715510 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.715635 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.715807 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.715933 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.716106 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.716218 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.716433 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.716558 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.716735 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.716859 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.717033 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.717175 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-15-iscsi {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.717341 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.717470 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.717640 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.717766 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.717952 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.718085 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.718254 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.718445 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.718647 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-15-iscsi {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.718804 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.718966 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.719099 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.719256 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.719394 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.719558 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.719701 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.719949 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.720094 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.720249 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.720371 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.720547 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.720671 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.720852 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.720983 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.721164 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.721288 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.721459 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.721589 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.721760 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.721893 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.722059 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.722185 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.722365 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.722487 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.722657 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.722786 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.722973 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.723093 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.723214 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.723344 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.723502 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.723632 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.723813 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.723954 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.724193 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.724492 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.724652 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.724777 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.724959 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.725084 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.725219 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.725350 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.725498 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.725622 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.725812 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.725937 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.726142 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.726274 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.726442 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.726573 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.726739 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.726863 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.727039 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.727162 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.727329 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.727464 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.727630 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.727760 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.727930 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.728054 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.728226 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.728348 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.728526 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.728656 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.728826 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.728958 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.729120 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.729253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.729416 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.729549 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.729712 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.729842 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.730016 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.730175 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.730317 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.730480 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.730609 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.730728 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.730930 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.731057 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.731232 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.731369 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.731545 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.731675 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.731856 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.731986 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.732154 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.732287 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.732450 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.732580 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.732747 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.732875 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.733056 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.733175 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.733358 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.733490 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.733655 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.733785 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.733987 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.734118 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.734237 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.734362 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.734482 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.734601 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.734748 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.734877 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.735058 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.735184 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.735356 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.735492 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.735666 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.735798 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.735960 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.736083 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.736251 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.736381 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.736546 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.736669 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.736843 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.736972 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.737140 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.737271 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.737435 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.737565 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.737729 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.737853 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.738017 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.738148 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.738312 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.738434 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.738604 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.738725 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.738934 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.739075 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.739203 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.739322 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.739587 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.739719 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.739894 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.740031 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.740230 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.740410 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.740563 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.740695 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.740860 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.740992 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.741169 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.741294 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.741477 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.741600 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.741784 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.741915 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.742081 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.742240 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.742391 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.742513 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.742690 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.742845 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.742994 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.743129 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.743264 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.743400 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.743572 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.743705 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.743863 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.743986 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.744159 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.744291 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.744456 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.744591 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.744750 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.744873 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.745047 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.745170 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.745339 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.745464 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.745637 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.745761 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.745928 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.746056 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.746220 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.746344 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.746510 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.746633 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.746802 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.746954 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.747114 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.747246 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.747406 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.747528 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.747699 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.747831 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.747994 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.748120 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.748290 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.748413 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.748581 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.748711 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.748876 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.749000 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.749166 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.749296 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.749473 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.749609 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.749786 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.749909 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.750085 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.750223 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.750409 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.750548 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.750671 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.750790 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.750990 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:18:01.751129 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.751318 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.751443 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.751634 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.751756 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.751955 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.752077 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.752261 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.752385 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.752597 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.752750 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.752872 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.752990 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.753159 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.753284 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.753469 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.753594 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.753776 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.753906 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.754087 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.754210 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.754392 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.754523 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.754700 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.754924 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.755062 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.755200 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.755402 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.755534 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.755720 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.755879 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.756043 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.756197 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.756355 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.756503 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.756665 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.756837 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.756982 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.757176 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.757300 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.757482 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.757606 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.757800 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.757934 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.758119 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.758276 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.758421 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.758579 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.758718 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.758933 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.759061 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.759277 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.759402 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.759583 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.759721 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.759902 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.760027 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.760215 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.760339 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.760550 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.760683 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.760813 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.760935 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.761102 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.761226 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.761407 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.761532 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.761711 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.761835 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.762028 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.762151 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.762335 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.762458 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.762636 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.762767 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.762961 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.763089 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.763267 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.763391 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.763570 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.763692 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.763874 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.764005 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.764175 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.764298 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.764474 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.764598 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.764770 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.764903 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.765069 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.765194 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.765379 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.765504 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.765677 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.765813 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.765980 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.766103 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.766287 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.766412 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.766585 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.766716 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.766881 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.767062 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.767193 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.767317 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.767492 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.767638 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.767792 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.767914 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.768093 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.768218 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.768389 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.768514 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.768693 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.768823 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.768993 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.769124 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.769282 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.769405 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.769588 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.769711 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.769889 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.770014 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.770188 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.770313 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.770483 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.770679 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.770878 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.771069 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.771193 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.771431 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.771643 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.771775 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.771974 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.772107 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.772281 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.772419 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.772583 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.772708 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.772901 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.773035 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.773200 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.773331 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.773501 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.773626 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.773811 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.773943 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.774117 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.774235 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.774423 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.774547 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.774728 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.774853 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.775060 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.775186 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.775379 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.775503 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.775689 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.775822 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.775985 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.776116 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.776291 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.776415 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.776592 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.776718 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.776891 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.777014 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.777190 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.777314 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.777494 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.777618 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.777790 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.777920 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.778087 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.778227 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.778384 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.778509 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.778680 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.778804 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.778984 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.779124 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.779283 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.779407 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.779586 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.779711 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.780225 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.780358 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.780523 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.780663 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.780843 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.780967 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.781095 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.781224 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.781385 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.781509 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.781706 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.781830 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.782009 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.782143 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.782305 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.782430 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.782601 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.782727 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.782956 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.783082 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.783242 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.783366 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.783543 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.783665 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.783847 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.783972 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.784150 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.784273 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.784455 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.784578 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.784768 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.784892 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.785070 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.785194 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.785380 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.785503 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.785681 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.785805 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.785981 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.786106 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.786285 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.786484 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.786646 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.786769 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.786939 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.787068 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.787252 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.787393 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.787582 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.787706 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.787899 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.788021 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.788207 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.788339 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.788509 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.788640 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.788812 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.788934 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.789108 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.789241 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.789411 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.789534 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.789715 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.789839 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.790017 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.790155 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.790320 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.790453 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.790630 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.790754 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.790975 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.791127 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.791252 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.791373 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.791552 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.791678 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.791858 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.791982 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.792158 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.792280 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.792459 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.792589 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.792753 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.792876 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.793058 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.793181 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.793365 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.793488 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.793668 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.793793 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.793979 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.794108 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.794278 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.794408 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.794587 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.794711 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.794884 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.795047 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.795210 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.795345 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.795522 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.795648 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.795822 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.795946 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.796120 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.796252 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.796420 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.796550 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.796724 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.796846 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.797024 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.797157 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.797323 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.797446 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.797621 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.797755 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.797917 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.798042 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.798214 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.798344 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.798513 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.798637 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.798810 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.798967 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.799136 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.799259 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.799439 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.799564 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.799736 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.799862 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.800044 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.800169 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.800345 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.800469 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.800640 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.800764 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.800936 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.801072 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.801255 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.801387 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.801534 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.801657 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.801830 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.801957 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.802173 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.802307 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.802471 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.802656 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.802802 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.802980 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.803130 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.803268 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.803425 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.803570 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.803734 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.803858 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.804046 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.804178 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.804346 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.804471 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.804649 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.804773 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.804951 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.805077 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.805250 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.805382 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.805567 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.805691 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.805874 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.805998 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.806177 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.806301 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.806481 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.806605 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.806783 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.806930 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.807111 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.807234 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.807412 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.807533 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.807723 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.807852 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.808025 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.808148 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.808327 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.808456 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.808627 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.808749 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.808926 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.809056 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.809224 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.809360 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.809526 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.809652 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.809843 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.810083 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.810216 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.810410 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.810534 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.810720 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.810844 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.811041 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.811164 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.811383 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.811569 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.811694 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.811812 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.811957 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.812196 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.812323 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.812524 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.812648 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.812837 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.812970 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.813153 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.813277 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.813451 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.813574 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.813748 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.813872 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.814050 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.814182 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.814350 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.814487 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.814649 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.814773 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.814966 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.815106 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.815275 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.815407 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.815573 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.815697 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.815867 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.815990 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.816160 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.816284 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.816458 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.816582 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.816752 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.816877 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.817045 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.817168 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.817346 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.817469 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.817670 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.817837 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.818166 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.818292 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.818571 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.818704 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.818825 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.819002 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.819126 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.819246 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.819365 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.819485 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.819653 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.819821 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.819946 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.820122 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.820245 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.820450 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.820574 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.820773 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.820899 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.821108 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.821237 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.821404 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.821526 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.821738 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.821864 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.822006 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.822130 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.822302 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.822434 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.822599 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.822723 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.822895 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.823036 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.823218 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.823360 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.823520 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.823653 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.823815 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.823947 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.824118 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.824270 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.824428 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.824545 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.824705 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.824828 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.824999 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.825131 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.825298 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.825428 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.825594 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.825726 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.825886 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.826018 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.826185 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.826315 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.826485 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.826607 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.826780 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.826967 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.827092 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.827212 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.827392 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.827516 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.827694 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.827819 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.827992 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.828118 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.828294 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.828424 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.828589 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.828721 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.828887 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.829011 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.829183 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.829319 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.829481 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.829607 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.829774 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.829891 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.830073 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.830205 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.830370 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.830495 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.830664 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.830794 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.830988 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.831130 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.831295 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.831419 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.831589 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.831740 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.831933 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.832066 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.832187 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.832309 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.832460 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.832585 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.832756 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.832880 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.833058 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.833238 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.833450 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.833605 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.833784 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.833917 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.834038 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.834294 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.834419 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.834596 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.834808 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.834964 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.835087 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.835229 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.835354 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.835546 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.835681 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.835847 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.835972 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.836152 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.836296 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.836451 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.836576 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.836747 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.836870 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.837042 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.837164 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.837343 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.837468 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.837638 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.837771 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.837937 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.838068 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.838233 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.838356 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.838531 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.838654 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.838824 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.839034 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.839170 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.839292 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.839453 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.839579 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.839755 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.839888 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.840056 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.840180 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.840354 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.840479 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.840675 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.840812 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.840974 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.841104 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.841272 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.841393 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.841565 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.841708 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.841863 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.842068 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.842191 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.842319 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.842446 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.842578 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.842745 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.842868 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.843076 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.843202 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.843374 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.843499 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.843685 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.843818 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.843987 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.844110 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.844286 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.844417 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.844582 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.844713 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.844880 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.845005 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.845193 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.845318 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.845492 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.845615 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.845792 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.845924 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.846092 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.846222 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.846390 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.846514 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.846692 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.846815 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.847019 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.847146 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.847321 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.847451 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.847624 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.847756 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.847924 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.848047 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.848224 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.848346 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.848520 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.848652 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.848843 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.848982 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.849182 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.849306 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.849482 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.849618 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.849779 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.849903 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.850080 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.850203 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.850380 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.850513 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.850671 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.850793 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.850997 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.851136 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.851295 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.851419 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.851598 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.851720 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.851893 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.852015 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.852226 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.852351 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.852471 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.852638 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.852771 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.852892 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.853050 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.853175 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.853346 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.853479 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.853750 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.853880 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.854054 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.854177 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.854357 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.854479 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.854653 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.854790 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.854970 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.855092 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.855268 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.855394 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.855577 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.855709 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.855882 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.856013 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.856248 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.856380 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.856545 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.856680 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.856847 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.856971 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.857166 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.857290 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.857463 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.857595 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.857763 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.857886 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.858059 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.858183 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.858370 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.858497 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.858667 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.858785 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.858997 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.859134 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.859405 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.859530 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.859705 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.859829 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.859999 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.860129 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.860307 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.860431 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.860623 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.860749 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.860974 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.861098 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.861288 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.861413 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.861600 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.861733 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.861914 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.862050 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.862257 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.862390 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.862511 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.862631 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.862801 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.863053 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.863199 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.863335 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.863461 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.863581 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.863741 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.863874 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.864046 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.864173 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.864340 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.864518 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.864704 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.864831 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.865019 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.865250 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.865380 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.865565 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.865689 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.865878 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.866011 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.866182 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.866316 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.866503 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.866629 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.866821 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.866977 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.867153 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.867286 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.867469 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.867595 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.867798 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.867940 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.868103 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.868228 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.868400 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.868524 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.868696 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.868829 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.869007 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.869131 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.869296 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.869419 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.869591 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.869724 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.869889 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.870015 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.870188 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.870320 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.870484 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.870608 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.870780 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.870957 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.871118 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.871259 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.871415 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.871541 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.871717 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.871841 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.872017 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.872140 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.872365 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.872501 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.872621 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.872742 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.872907 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.873038 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.873246 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.873368 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.873489 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.873610 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.873786 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.873918 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.874080 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.874205 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.874375 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.874499 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.874679 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.874811 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.875012 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.875149 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.875314 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.875437 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.875612 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.875755 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.875909 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.876041 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.876206 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.876339 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.876536 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.876670 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.876834 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.876959 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.877143 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.877267 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.877457 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.877582 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.877771 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.877895 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.878068 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.878198 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.878365 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.878501 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.878668 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.878793 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.878991 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.879129 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.879289 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.879415 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.879584 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.879709 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.879882 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.880015 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.880213 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.880371 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.880497 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.880676 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.880812 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.880944 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.881076 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.881197 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.881347 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.881479 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.881660 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.881792 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.881955 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.882079 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.882248 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.882371 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.882573 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.882713 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.882836 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.882976 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.883154 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.883280 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.883451 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.883583 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.883756 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.883879 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.884055 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.884180 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.884354 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.884482 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.884650 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.884783 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.884955 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.885078 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.885261 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.885388 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.885572 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.885697 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.885875 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.886006 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.886179 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.886304 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.886486 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.886618 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.886788 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.886978 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.887104 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.887224 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.887415 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.887543 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.887720 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.887852 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.888030 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.888230 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.888355 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.888552 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.888675 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.888858 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.888984 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.889165 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.889289 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.889470 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.889594 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.889779 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.890011 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.890136 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.890337 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.890455 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.890647 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.890780 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.890974 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.891100 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.891279 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.891403 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.891586 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.891712 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.891892 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.892018 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.892195 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.892320 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.892497 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.892707 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.892840 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.892962 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.893091 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.893230 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.893397 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.893521 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.893701 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.893825 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.894015 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.894153 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.894340 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.894463 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.894639 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.894764 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.894949 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.895073 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.895261 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.895385 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.895565 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.895766 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.896007 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.896177 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.896417 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.896622 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.896867 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.897000 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.902282 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.902437 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.902566 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.902704 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.902894 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.903059 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.903184 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.903304 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.903425 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.903547 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.903547 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.903785 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.903907 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.904107 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.904261 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.904389 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.904513 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.904652 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.904784 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.905245 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.905374 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.905496 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.905626 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.905750 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.905870 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.906000 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.906122 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.906243 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.906441 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.906574 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.906697 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.906887 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.907036 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.907158 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.907298 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.907422 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.907543 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.907664 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.907664 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.907901 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.908023 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.908143 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.908270 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.908392 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.908513 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.908645 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.908775 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.908904 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.909026 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.909146 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.909274 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.909389 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.909496 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.909599 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.909701 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.909805 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.909927 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.910055 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.910055 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.910298 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.910420 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.910547 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.910666 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.910786 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.910962 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.911087 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.911208 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.911208 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.912085 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.912085 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.912329 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.912509 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.912669 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.912822 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.913068 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.913228 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.913381 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.913506 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.913626 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.913756 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.913888 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.914011 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.914133 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.914254 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.914375 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.914507 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.914630 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.914751 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.914872 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.915026 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.915026 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.915271 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.915425 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.915546 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.915666 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.915793 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.915916 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.916049 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.916184 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.916306 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.916427 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.916546 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.916751 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.916884 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.917006 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.917126 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.917248 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.917374 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.917504 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.917626 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.917746 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.917865 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.917985 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.918105 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.918234 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.918369 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.918490 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.918611 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.918744 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.918871 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.919037 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.919162 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.919284 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.919401 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.919522 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.919641 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.919770 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.919891 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.920020 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.920141 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.920261 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.920419 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.920546 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.920665 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.920665 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.920881 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.921001 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.921129 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.921251 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.921373 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.921493 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.921623 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.921744 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.921874 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.921995 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.922116 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.922235 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.922356 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.922484 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.922614 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.922742 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.922864 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.923031 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.923221 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.923363 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.923363 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.923609 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.923609 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.923839 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.923839 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.924079 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.924079 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.924349 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.924495 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.924680 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.924803 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.924936 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.925058 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.925058 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.925286 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.925406 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.925533 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.925664 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.925786 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.925906 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.926026 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.926155 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.926283 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.926407 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.926526 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.926647 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.926767 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.926887 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.927187 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.927689 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.927827 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.927951 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.928071 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.928193 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.928328 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.928452 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.928573 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.928695 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.928822 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.928953 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.929075 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.929075 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.929303 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.929423 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.929534 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.929661 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.929785 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.929911 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.930040 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.930162 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.930282 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.930411 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.930533 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.930653 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.930774 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.930885 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.931112 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.931244 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.931367 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.931487 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.931608 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.931741 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.931873 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.931995 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.932123 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.932246 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.932367 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.932487 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.932615 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.932738 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.932858 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.932980 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.933107 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.933250 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.933455 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.933582 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.933705 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.933826 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.933955 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.934084 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.934207 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.934326 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.934447 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.934567 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.934692 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.934821 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.934982 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.935133 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.935307 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.935452 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.935574 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.935709 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.935840 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.935969 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.936092 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.936212 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.936350 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.936496 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.936621 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.936742 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.936863 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.936983 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.937114 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.937236 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.937357 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.937477 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.937597 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.937718 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.937847 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.937969 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.938089 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.938218 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.938339 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.938473 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.938594 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.938715 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.938835 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.938971 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.939105 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.939239 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.939362 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.939509 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.939633 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.939839 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.940020 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.940166 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.940299 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.940421 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.940543 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.940667 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.940788 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.940994 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.941173 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.941308 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.941433 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.941566 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.941702 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.941824 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.941947 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.942145 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.942324 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.942473 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.942647 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.942959 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.943116 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.943322 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.943555 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.943697 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.943836 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.943962 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.944086 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.944208 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.944328 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.944460 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.944592 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.944715 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.944836 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.944957 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.945077 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.945207 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.945329 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.945502 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.945637 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.945819 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.945944 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.946133 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.946267 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.946444 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.946571 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.946747 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.946872 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.947093 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.947232 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.947395 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.947519 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.947700 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.947838 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.948005 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.948131 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.948310 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.948434 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.948610 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.948742 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.948912 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.949047 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.949225 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.949348 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.949531 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.949665 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.949827 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.949958 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.950130 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.950261 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.950434 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.950568 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.950744 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.950870 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.951079 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.951202 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.951384 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.951511 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.951683 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.951814 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.951995 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.952118 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.952298 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.952431 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.952611 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.952735 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.952892 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.953016 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.953195 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.953321 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.953504 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.953708 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.953839 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.953970 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.954092 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.954213 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.954390 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.954514 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.954697 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.954835 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.955025 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.955151 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.955336 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.955463 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.963758 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.964184 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.964349 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.964481 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.964604 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.964726 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.964855 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.964962 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.965080 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.965200 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.965318 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.965450 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.965651 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.965774 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.965894 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.966014 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.966134 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.966261 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.966391 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.966521 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.966521 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 10:18:01.966748 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.966748 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.966748 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.966748 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.966748 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.966748 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:18:01.966748 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 10:18:02.115806 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO dbcounter [None req-9ca9787b-965f-4243-9137-0f7ef8b674ce None None] Registered counter for database nova_api Aug 05 10:18:02.119008 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO dbcounter [None req-7ce7f769-d173-4116-a3f3-3b2ce63cc105 None None] Registered counter for database nova_api Aug 05 10:18:02.138374 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG oslo_db.sqlalchemy.engines [None req-9ca9787b-965f-4243-9137-0f7ef8b674ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 10:18:02.140277 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_db.sqlalchemy.engines [None req-7ce7f769-d173-4116-a3f3-3b2ce63cc105 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 10:18:02.145618 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG dbcounter [-] [103124] Writer thread running {{(pid=103124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 10:18:02.147332 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writer thread running {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 10:18:02.200706 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.context [None req-9ca9787b-965f-4243-9137-0f7ef8b674ce None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f636a431-9fc7-40b9-b93c-769f38c3c626(cell1) {{(pid=103124) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 10:18:02.202401 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.context [None req-7ce7f769-d173-4116-a3f3-3b2ce63cc105 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f636a431-9fc7-40b9-b93c-769f38c3c626(cell1) {{(pid=103123) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 10:18:02.204642 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG oslo_concurrency.lockutils [None req-9ca9787b-965f-4243-9137-0f7ef8b674ce None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:18:02.205112 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG oslo_concurrency.lockutils [None req-9ca9787b-965f-4243-9137-0f7ef8b674ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:18:02.206235 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-7ce7f769-d173-4116-a3f3-3b2ce63cc105 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:18:02.206675 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG oslo_concurrency.lockutils [None req-9ca9787b-965f-4243-9137-0f7ef8b674ce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:18:02.206811 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-7ce7f769-d173-4116-a3f3-3b2ce63cc105 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:18:02.207410 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG oslo_concurrency.lockutils [None req-9ca9787b-965f-4243-9137-0f7ef8b674ce None None] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:18:02.207842 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG oslo_concurrency.lockutils [None req-9ca9787b-965f-4243-9137-0f7ef8b674ce None None] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:18:02.208724 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-7ce7f769-d173-4116-a3f3-3b2ce63cc105 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:18:02.209436 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-7ce7f769-d173-4116-a3f3-3b2ce63cc105 None None] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:18:02.209872 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-7ce7f769-d173-4116-a3f3-3b2ce63cc105 None None] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:18:02.210008 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG oslo_concurrency.lockutils [None req-9ca9787b-965f-4243-9137-0f7ef8b674ce None None] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:18:02.211880 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-7ce7f769-d173-4116-a3f3-3b2ce63cc105 None None] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:18:02.212042 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO dbcounter [None req-9ca9787b-965f-4243-9137-0f7ef8b674ce None None] Registered counter for database nova_cell0 Aug 05 10:18:02.213930 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO dbcounter [None req-7ce7f769-d173-4116-a3f3-3b2ce63cc105 None None] Registered counter for database nova_cell0 Aug 05 10:18:02.217420 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO dbcounter [None req-9ca9787b-965f-4243-9137-0f7ef8b674ce None None] Registered counter for database nova_cell1 Aug 05 10:18:02.219681 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO dbcounter [None req-7ce7f769-d173-4116-a3f3-3b2ce63cc105 None None] Registered counter for database nova_cell1 Aug 05 10:18:02.225590 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG oslo_db.sqlalchemy.engines [None req-9ca9787b-965f-4243-9137-0f7ef8b674ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 10:18:02.227235 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_db.sqlalchemy.engines [None req-7ce7f769-d173-4116-a3f3-3b2ce63cc105 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 10:18:02.228874 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG oslo_db.sqlalchemy.engines [None req-9ca9787b-965f-4243-9137-0f7ef8b674ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 10:18:02.232779 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG dbcounter [-] [103124] Writer thread running {{(pid=103124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 10:18:02.233122 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writer thread running {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 10:18:02.234778 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_db.sqlalchemy.engines [None req-7ce7f769-d173-4116-a3f3-3b2ce63cc105 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 10:18:02.235975 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG dbcounter [-] [103124] Writer thread running {{(pid=103124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 10:18:02.371142 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writer thread running {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 10:18:02.375690 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO dbcounter [None req-9ca9787b-965f-4243-9137-0f7ef8b674ce None None] Registered counter for database nova_cell0 Aug 05 10:18:02.379941 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO dbcounter [None req-7ce7f769-d173-4116-a3f3-3b2ce63cc105 None None] Registered counter for database nova_cell0 Aug 05 10:18:02.386091 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG oslo_db.sqlalchemy.engines [None req-9ca9787b-965f-4243-9137-0f7ef8b674ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 10:18:02.387786 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_db.sqlalchemy.engines [None req-7ce7f769-d173-4116-a3f3-3b2ce63cc105 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 10:18:02.391189 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG dbcounter [-] [103124] Writer thread running {{(pid=103124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 10:18:02.392608 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writer thread running {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 10:18:02.727097 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: WARNING keystonemiddleware.auth_token [None req-7ce7f769-d173-4116-a3f3-3b2ce63cc105 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 10:18:02.729051 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: WARNING keystonemiddleware.auth_token [None req-9ca9787b-965f-4243-9137-0f7ef8b674ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 10:18:02.734334 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: WARNING keystonemiddleware.auth_token [None req-7ce7f769-d173-4116-a3f3-3b2ce63cc105 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 10:18:02.736322 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: WARNING keystonemiddleware.auth_token [None req-9ca9787b-965f-4243-9137-0f7ef8b674ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 10:18:03.080270 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: WARNING keystonemiddleware.auth_token [None req-9ca9787b-965f-4243-9137-0f7ef8b674ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 10:18:03.081818 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: WARNING keystonemiddleware.auth_token [None req-7ce7f769-d173-4116-a3f3-3b2ce63cc105 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 10:18:03.086236 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: WARNING keystonemiddleware.auth_token [None req-9ca9787b-965f-4243-9137-0f7ef8b674ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 10:18:03.087855 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: WARNING keystonemiddleware.auth_token [None req-7ce7f769-d173-4116-a3f3-3b2ce63cc105 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 10:18:03.091569 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557296ec99c0 pid: 103124 (default app) Aug 05 10:18:03.093096 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557296ec99c0 pid: 103123 (default app) Aug 05 10:18:03.093680 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-9ca9787b-965f-4243-9137-0f7ef8b674ce None None] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:18:03.094874 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-9ca9787b-965f-4243-9137-0f7ef8b674ce None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001755 Aug 05 10:18:03.095288 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Fri Aug 5 10:18:03 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:19:19.156844 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-7ce7f769-d173-4116-a3f3-3b2ce63cc105 None None] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:19:19.158044 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-7ce7f769-d173-4116-a3f3-3b2ce63cc105 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001970 Aug 05 10:19:19.158602 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 1/2] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 10:19:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:19:19.170467 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG dbcounter [-] [103124] Writing DB stats nova_api:SELECT=3 {{(pid=103124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:19:19.171704 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG dbcounter [-] [103124] Writing DB stats nova_cell1:SELECT=3 {{(pid=103124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:19:19.172841 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG dbcounter [-] [103124] Writing DB stats nova_cell0:SELECT=3 {{(pid=103124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:19:19.173669 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG dbcounter [-] [103124] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:19:20.018484 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-bf48cf62-f1e9-4cb9-b6d3-cea75ee85cdc admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:19:20.051269 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-bf48cf62-f1e9-4cb9-b6d3-cea75ee85cdc admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.886062 Aug 05 10:19:20.052157 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 2/3] 10.222.0.40 () {60 vars in 1292 bytes} [Fri Aug 5 10:19:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:19:22.242393 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-7ce7f769-d173-4116-a3f3-3b2ce63cc105 None None] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:19:22.243445 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-7ce7f769-d173-4116-a3f3-3b2ce63cc105 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 05 10:19:22.244044 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 2/4] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 10:19:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:19:22.746716 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-0d032842-9152-4d03-8857-5090e766c35e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "id": "c1", "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "name": "cirros256"}} {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:19:22.767518 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 10:19:22.767518 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: warnings.warn(msg) Aug 05 10:19:22.800059 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-0d032842-9152-4d03-8857-5090e766c35e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.550000 Aug 05 10:19:22.800987 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 3/5] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 5 10:19:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 10:19:23.017410 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-d0555c6f-2d0d-40a2-b9aa-36492d86e2a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:19:23.021815 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 10:19:23.021815 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: warnings.warn(msg) Aug 05 10:19:23.037489 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_api:SELECT=3 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:19:23.038319 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_cell0:SELECT=3 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:19:23.039046 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_cell1:SELECT=3 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:19:23.039773 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:19:23.093565 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-d0555c6f-2d0d-40a2-b9aa-36492d86e2a8 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283587 Aug 05 10:19:23.094690 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 3/6] 10.222.0.40 () {64 vars in 1336 bytes} [Fri Aug 5 10:19:22 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:19:25.339290 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-0d032842-9152-4d03-8857-5090e766c35e admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:19:25.340323 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-0d032842-9152-4d03-8857-5090e766c35e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Aug 05 10:19:25.340879 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 4/7] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 10:19:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:19:26.037017 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-4af353cc-e78f-4b14-9802-09f32de5398c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "ram": 512, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 5}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:19:26.056536 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 10:19:26.056536 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: warnings.warn(msg) Aug 05 10:19:26.078881 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-4af353cc-e78f-4b14-9802-09f32de5398c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.731691 Aug 05 10:19:26.079703 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 4/8] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 5 10:19:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 10:19:26.091738 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-76a76083-3a42-4646-ab7c-c769bbbf0b41 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:19:26.095307 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 10:19:26.095307 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: warnings.warn(msg) Aug 05 10:19:26.131643 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-76a76083-3a42-4646-ab7c-c769bbbf0b41 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043592 Aug 05 10:19:26.132235 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 5/9] 10.222.0.40 () {64 vars in 1336 bytes} [Fri Aug 5 10:19:26 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:19:28.400528 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-4af353cc-e78f-4b14-9802-09f32de5398c admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:19:28.401548 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-4af353cc-e78f-4b14-9802-09f32de5398c admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 05 10:19:28.401939 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 5/10] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 10:19:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:19:28.809822 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-ab089a53-fa9e-4920-95bf-b10a6e679032 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "id": "d2", "disk": 10, "ram": 1024, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:19:28.830885 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-ab089a53-fa9e-4920-95bf-b10a6e679032 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.422540 Aug 05 10:19:28.831453 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 6/11] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 5 10:19:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 10:19:28.844132 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-4009c3e3-860f-47db-8cb9-0a683db97c86 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:19:28.869728 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-4009c3e3-860f-47db-8cb9-0a683db97c86 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029867 Aug 05 10:19:28.870310 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 6/12] 10.222.0.40 () {64 vars in 1336 bytes} [Fri Aug 5 10:19:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:19:31.051844 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-ab089a53-fa9e-4920-95bf-b10a6e679032 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:19:31.052903 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-ab089a53-fa9e-4920-95bf-b10a6e679032 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 05 10:19:31.053469 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 7/13] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 10:19:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:19:31.504188 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-8a8ed91a-a734-47b3-a806-ef890243172c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G", "id": "d3", "swap": 0}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:19:31.524971 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-8a8ed91a-a734-47b3-a806-ef890243172c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.465814 Aug 05 10:19:31.525816 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 7/14] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 5 10:19:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 10:19:31.537982 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-c1bf9dd8-737e-4621-8b01-46c0ff43b553 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:19:31.564699 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-c1bf9dd8-737e-4621-8b01-46c0ff43b553 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030385 Aug 05 10:19:31.565617 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 8/15] 10.222.0.40 () {64 vars in 1336 bytes} [Fri Aug 5 10:19:31 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:19:33.745908 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-8a8ed91a-a734-47b3-a806-ef890243172c admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:19:33.747886 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-8a8ed91a-a734-47b3-a806-ef890243172c admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002104 Aug 05 10:19:33.750733 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 8/16] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 10:19:33 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:19:34.184122 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-98cd4c9d-1902-48a7-804d-75c3862fa8fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "id": "d4", "os-flavor-access:is_public": true, "name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4}} {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:19:34.207984 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-98cd4c9d-1902-48a7-804d-75c3862fa8fe admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.453814 Aug 05 10:19:34.208519 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 9/17] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 5 10:19:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 10:19:34.220701 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-03f17c68-7f20-495d-b9c2-2b31b8be1865 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:19:34.248909 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-03f17c68-7f20-495d-b9c2-2b31b8be1865 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031075 Aug 05 10:19:34.250995 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 9/18] 10.222.0.40 () {64 vars in 1336 bytes} [Fri Aug 5 10:19:34 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:19:36.438025 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-98cd4c9d-1902-48a7-804d-75c3862fa8fe admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:19:36.438982 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-98cd4c9d-1902-48a7-804d-75c3862fa8fe admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 05 10:19:36.439361 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 10/19] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 10:19:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:19:36.977006 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-62ebe440-2d35-493a-b9ac-8f225f7535ec admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:19:37.001168 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-62ebe440-2d35-493a-b9ac-8f225f7535ec admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.555009 Aug 05 10:19:37.001707 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 10/20] 10.222.0.40 () {60 vars in 1292 bytes} [Fri Aug 5 10:19:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:19:39.217290 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-98cd4c9d-1902-48a7-804d-75c3862fa8fe admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:19:39.218247 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-98cd4c9d-1902-48a7-804d-75c3862fa8fe admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001724 Aug 05 10:19:39.218659 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 11/21] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 10:19:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:19:39.693703 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-067dafa5-63e9-4cb9-8083-8090a8419f75 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 512, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:19:39.714841 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-067dafa5-63e9-4cb9-8083-8090a8419f75 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.489788 Aug 05 10:19:39.715740 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 11/22] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 5 10:19:39 2022] POST /compute/v2.1/flavors => generated 402 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 10:19:39.727877 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-9caa8e7e-3150-42af-a01b-54df4aa4975b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:19:39.753930 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-9caa8e7e-3150-42af-a01b-54df4aa4975b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029804 Aug 05 10:19:39.754861 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 12/23] 10.222.0.40 () {64 vars in 1333 bytes} [Fri Aug 5 10:19:39 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:19:42.395143 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-067dafa5-63e9-4cb9-8083-8090a8419f75 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:19:42.396157 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-067dafa5-63e9-4cb9-8083-8090a8419f75 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 05 10:19:42.396545 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 12/24] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 10:19:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:19:42.800875 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-f4e7500e-d500-4389-8814-9de8efc8b4f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "name": "m1.small", "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "swap": 0}} {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:19:42.821405 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-f4e7500e-d500-4389-8814-9de8efc8b4f9 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.418042 Aug 05 10:19:42.821934 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 13/25] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 5 10:19:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 10:19:42.834393 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-9fdf8415-e8db-488c-882c-62dc97b03e90 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:19:42.860374 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-9fdf8415-e8db-488c-882c-62dc97b03e90 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029880 Aug 05 10:19:42.860947 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 13/26] 10.222.0.40 () {64 vars in 1333 bytes} [Fri Aug 5 10:19:42 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:19:45.061138 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-f4e7500e-d500-4389-8814-9de8efc8b4f9 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:19:45.062144 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-f4e7500e-d500-4389-8814-9de8efc8b4f9 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 05 10:19:45.062580 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 14/27] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 10:19:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:19:45.474623 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-36cf4c6b-7bba-484e-9892-7be2c909a001 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 2, "rxtx_factor": 1.0, "name": "m1.medium", "swap": 0, "disk": 40, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:19:45.501247 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-36cf4c6b-7bba-484e-9892-7be2c909a001 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.432476 Aug 05 10:19:45.502080 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 14/28] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 5 10:19:45 2022] POST /compute/v2.1/flavors => generated 406 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 10:19:45.513846 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-6405c0c8-98fb-400f-91ed-b929d7910b1d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:19:45.539756 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-6405c0c8-98fb-400f-91ed-b929d7910b1d admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029526 Aug 05 10:19:45.540898 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 15/29] 10.222.0.40 () {64 vars in 1333 bytes} [Fri Aug 5 10:19:45 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:19:47.740908 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-36cf4c6b-7bba-484e-9892-7be2c909a001 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:19:47.741947 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-36cf4c6b-7bba-484e-9892-7be2c909a001 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 05 10:19:47.742374 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 15/30] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 10:19:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:19:48.225187 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-5b1864be-9c05-413a-bdcf-4cca4ec0d9aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "disk": 80, "name": "m1.large", "vcpus": 4, "ram": 8192}} {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:19:48.249219 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-5b1864be-9c05-413a-bdcf-4cca4ec0d9aa admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.500781 Aug 05 10:19:48.257237 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 16/31] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 5 10:19:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 10:19:48.262268 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-b68e2c78-4395-4766-8521-dd6a63aba8b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:19:48.289692 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-b68e2c78-4395-4766-8521-dd6a63aba8b4 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031096 Aug 05 10:19:48.290285 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 16/32] 10.222.0.40 () {64 vars in 1333 bytes} [Fri Aug 5 10:19:48 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:19:50.489976 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-5b1864be-9c05-413a-bdcf-4cca4ec0d9aa admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:19:50.491021 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-5b1864be-9c05-413a-bdcf-4cca4ec0d9aa admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 05 10:19:50.491614 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 17/33] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 10:19:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:19:50.934857 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-ce1fcebb-7b1d-43aa-a5aa-807f4cda5e1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "vcpus": 8, "id": "5", "disk": 160, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge"}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:19:50.956907 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-ce1fcebb-7b1d-43aa-a5aa-807f4cda5e1d admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.458549 Aug 05 10:19:50.957467 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 17/34] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 5 10:19:50 2022] POST /compute/v2.1/flavors => generated 408 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 10:19:50.970033 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-7426d52f-2ecb-424f-b321-25aaf53da8dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:19:50.975014 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG dbcounter [-] [103124] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:19:51.002382 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-7426d52f-2ecb-424f-b321-25aaf53da8dd admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036004 Aug 05 10:19:51.002938 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 18/35] 10.222.0.40 () {64 vars in 1333 bytes} [Fri Aug 5 10:19:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:20:10.561838 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-ce1fcebb-7b1d-43aa-a5aa-807f4cda5e1d admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:20:10.563322 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-ce1fcebb-7b1d-43aa-a5aa-807f4cda5e1d admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Aug 05 10:20:10.563865 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 18/36] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 10:20:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:20:10.577902 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG dbcounter [-] [103124] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:20:10.999130 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-3f22718c-ece5-4e68-8b99-578ff751ce55 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:20:11.021307 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-3f22718c-ece5-4e68-8b99-578ff751ce55 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.447666 Aug 05 10:20:11.021831 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 19/37] 10.222.0.40 () {60 vars in 1292 bytes} [Fri Aug 5 10:20:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:20:12.270339 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-ce1fcebb-7b1d-43aa-a5aa-807f4cda5e1d admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:20:12.271720 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-ce1fcebb-7b1d-43aa-a5aa-807f4cda5e1d admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001807 Aug 05 10:20:12.272132 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 19/38] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 5 10:20:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:20:12.844523 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-be141875-3dee-462a-9246-3b1954981d04 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:20:12.850360 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.wsgi [None req-be141875-3dee-462a-9246-3b1954981d04 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 05 10:20:12.853595 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-be141875-3dee-462a-9246-3b1954981d04 admin admin] Request method failure captured: Aug 05 10:20:12.853595 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 05 10:20:12.853595 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: Accept: application/json Aug 05 10:20:12.853595 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: Accept-Encoding: gzip, deflate Aug 05 10:20:12.853595 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: Connection: keep-alive Aug 05 10:20:12.853595 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: Content-Length: 0 Aug 05 10:20:12.853595 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: Host: 10.222.0.40 Aug 05 10:20:12.853595 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: Openstack-Api-Version: compute 2.90 Aug 05 10:20:12.853595 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: Openstack-System-Scope: None Aug 05 10:20:12.853595 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: User-Agent: python-novaclient Aug 05 10:20:12.853595 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Auth-Token: gAAAAABi7O7cHafAEHI786ncFJeOR4j2HVNcD-JlVYYvheR409gQZpIkqCskmd_-QWL0P0fH75VFqufqaLJKoDQ6_5m5Y6-bwpw14Eylgk2-RvHUt_RbvPWLMXlDbDL9zi84J7q8sUSjEYYfbTV-cOAf3-4Bzqp2HucJmTj9gYDCke8-wFQ5pnA Aug 05 10:20:12.853595 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Domain-Id: None Aug 05 10:20:12.853595 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Domain-Name: None Aug 05 10:20:12.853595 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Identity-Status: Confirmed Aug 05 10:20:12.853595 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Is-Admin-Project: True Aug 05 10:20:12.853595 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 10:20:12.853595 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Project-Domain-Id: default Aug 05 10:20:12.853595 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Project-Domain-Name: Default Aug 05 10:20:12.853595 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Project-Id: be89c43472bc49a2bd0e46cddf175958 Aug 05 10:20:12.853595 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Project-Name: admin Aug 05 10:20:12.853595 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Role: member,reader,admin Aug 05 10:20:12.853595 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Roles: member,reader,admin Aug 05 10:20:12.855082 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_be89c43472bc49a2bd0e46cddf175958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/be89c43472bc49a2bd0e46cddf175958"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be89c43472bc49a2bd0e46cddf175958"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be89c43472bc49a2bd0e46cddf175958"}]}] Aug 05 10:20:12.855082 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Tenant: admin Aug 05 10:20:12.855082 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Tenant-Id: be89c43472bc49a2bd0e46cddf175958 Aug 05 10:20:12.855082 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Tenant-Name: admin Aug 05 10:20:12.855082 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-User: admin Aug 05 10:20:12.855082 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-User-Domain-Id: default Aug 05 10:20:12.855082 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-User-Domain-Name: Default Aug 05 10:20:12.855082 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-User-Id: 898d0645ae1e477983200e39184fa9ed Aug 05 10:20:12.855082 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-User-Name: admin Aug 05 10:20:12.855082 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: method: > Aug 05 10:20:12.855082 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: exception: Flavor 42 could not be found. Aug 05 10:20:12.855082 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: action_args: {'id': '42'} Aug 05 10:20:12.855082 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:20:12.855082 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:20:12.855930 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 10:20:12.855930 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 10:20:12.855930 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 10:20:12.855930 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 10:20:12.855930 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 10:20:12.855930 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 10:20:12.855930 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 10:20:12.855930 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 10:20:12.855930 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 10:20:12.855930 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:20:12.855930 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 10:20:12.855930 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 10:20:12.855930 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 05 10:20:12.855930 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Aug 05 10:20:12.855930 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:20:12.855930 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Aug 05 10:20:12.855930 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:20:12.855930 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:20:12.855930 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:20:12.857140 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:20:12.857140 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:20:12.857140 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:20:12.857140 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:20:12.857140 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 10:20:12.857140 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:20:12.857140 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 05 10:20:12.857140 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Aug 05 10:20:12.857140 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:20:12.857140 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Aug 05 10:20:12.857140 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:20:12.857140 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:20:12.857140 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:20:12.857140 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:20:12.857140 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:20:12.857140 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 05 10:20:12.857140 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Aug 05 10:20:12.857140 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-be141875-3dee-462a-9246-3b1954981d04 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:20:12.858172 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-be141875-3dee-462a-9246-3b1954981d04 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.442976 Aug 05 10:20:12.858172 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 20/39] 10.222.0.40 () {60 vars in 1190 bytes} [Fri Aug 5 10:20:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 444 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 10:20:12.865151 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-6c854a6c-78f6-46de-8be8-e7c617e3ea0c admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:20:12.869367 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:20:12.888389 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-6c854a6c-78f6-46de-8be8-e7c617e3ea0c admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026830 Aug 05 10:20:12.888953 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 20/40] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Aug 5 10:20:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:20:12.900197 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-df57c02a-d691-41a8-a5ab-179fb41aed28 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:20:12.924781 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-df57c02a-d691-41a8-a5ab-179fb41aed28 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028936 Aug 05 10:20:12.925364 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 21/41] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Aug 5 10:20:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:20:12.937876 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-0120e090-501a-4585-a0ee-a429470b5454 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:20:12.944273 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.wsgi [None req-0120e090-501a-4585-a0ee-a429470b5454 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 05 10:20:12.947608 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-0120e090-501a-4585-a0ee-a429470b5454 admin admin] Request method failure captured: Aug 05 10:20:12.947608 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 05 10:20:12.947608 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: Accept: application/json Aug 05 10:20:12.947608 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: Accept-Encoding: gzip, deflate Aug 05 10:20:12.947608 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: Connection: keep-alive Aug 05 10:20:12.947608 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: Content-Length: 0 Aug 05 10:20:12.947608 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: Host: 10.222.0.40 Aug 05 10:20:12.947608 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: Openstack-Api-Version: compute 2.90 Aug 05 10:20:12.947608 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: Openstack-System-Scope: None Aug 05 10:20:12.947608 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: User-Agent: python-novaclient Aug 05 10:20:12.947608 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Auth-Token: gAAAAABi7O7cHafAEHI786ncFJeOR4j2HVNcD-JlVYYvheR409gQZpIkqCskmd_-QWL0P0fH75VFqufqaLJKoDQ6_5m5Y6-bwpw14Eylgk2-RvHUt_RbvPWLMXlDbDL9zi84J7q8sUSjEYYfbTV-cOAf3-4Bzqp2HucJmTj9gYDCke8-wFQ5pnA Aug 05 10:20:12.947608 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Domain-Id: None Aug 05 10:20:12.947608 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Domain-Name: None Aug 05 10:20:12.947608 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Identity-Status: Confirmed Aug 05 10:20:12.947608 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Is-Admin-Project: True Aug 05 10:20:12.947608 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 10:20:12.947608 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Project-Domain-Id: default Aug 05 10:20:12.947608 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Project-Domain-Name: Default Aug 05 10:20:12.947608 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Project-Id: be89c43472bc49a2bd0e46cddf175958 Aug 05 10:20:12.947608 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Project-Name: admin Aug 05 10:20:12.947608 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Role: member,reader,admin Aug 05 10:20:12.947608 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Roles: member,reader,admin Aug 05 10:20:12.949200 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_be89c43472bc49a2bd0e46cddf175958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/be89c43472bc49a2bd0e46cddf175958"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be89c43472bc49a2bd0e46cddf175958"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be89c43472bc49a2bd0e46cddf175958"}]}] Aug 05 10:20:12.949200 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Tenant: admin Aug 05 10:20:12.949200 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Tenant-Id: be89c43472bc49a2bd0e46cddf175958 Aug 05 10:20:12.949200 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Tenant-Name: admin Aug 05 10:20:12.949200 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-User: admin Aug 05 10:20:12.949200 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-User-Domain-Id: default Aug 05 10:20:12.949200 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-User-Domain-Name: Default Aug 05 10:20:12.949200 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-User-Id: 898d0645ae1e477983200e39184fa9ed Aug 05 10:20:12.949200 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-User-Name: admin Aug 05 10:20:12.949200 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: method: > Aug 05 10:20:12.949200 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: exception: Flavor 42 could not be found. Aug 05 10:20:12.949200 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: action_args: {'id': '42'} Aug 05 10:20:12.949200 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:20:12.949200 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:20:12.950045 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 10:20:12.950045 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 10:20:12.950045 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 10:20:12.950045 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 10:20:12.950045 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 10:20:12.950045 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 10:20:12.950045 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 10:20:12.950045 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 10:20:12.950045 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 10:20:12.950045 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:20:12.950045 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 10:20:12.950045 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 10:20:12.950045 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 05 10:20:12.950045 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 05 10:20:12.950045 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:20:12.950045 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 05 10:20:12.950045 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:20:12.950045 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:20:12.950045 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:20:12.951213 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:20:12.951213 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:20:12.951213 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:20:12.951213 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:20:12.951213 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 10:20:12.951213 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:20:12.951213 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 05 10:20:12.951213 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 05 10:20:12.951213 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:20:12.951213 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 05 10:20:12.951213 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:20:12.951213 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:20:12.951213 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:20:12.951213 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:20:12.951213 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:20:12.951213 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 05 10:20:12.951213 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 05 10:20:12.951213 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-0120e090-501a-4585-a0ee-a429470b5454 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:20:12.952351 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-0120e090-501a-4585-a0ee-a429470b5454 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015518 Aug 05 10:20:12.952351 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 21/42] 10.222.0.40 () {60 vars in 1190 bytes} [Fri Aug 5 10:20:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 10:20:13.935902 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-df57c02a-d691-41a8-a5ab-179fb41aed28 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:20:13.937292 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-df57c02a-d691-41a8-a5ab-179fb41aed28 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002083 Aug 05 10:20:13.937944 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 22/43] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 5 10:20:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:20:14.530464 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-eeab56de-4304-4026-9519-47429480ce0a admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:20:14.537736 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.wsgi [None req-eeab56de-4304-4026-9519-47429480ce0a admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 05 10:20:14.539253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-eeab56de-4304-4026-9519-47429480ce0a admin admin] Request method failure captured: Aug 05 10:20:14.539253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 05 10:20:14.539253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: Accept: application/json Aug 05 10:20:14.539253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: Accept-Encoding: gzip, deflate Aug 05 10:20:14.539253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: Connection: keep-alive Aug 05 10:20:14.539253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: Content-Length: 0 Aug 05 10:20:14.539253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: Host: 10.222.0.40 Aug 05 10:20:14.539253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: Openstack-Api-Version: compute 2.90 Aug 05 10:20:14.539253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: Openstack-System-Scope: None Aug 05 10:20:14.539253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: User-Agent: python-novaclient Aug 05 10:20:14.539253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Auth-Token: gAAAAABi7O7d-M_X3Tz3_RovZ3wIgcKv2KPu4sLvHXZaLuMFpnxgNfwNQ6uhQcb80ISQX_41Et7g6_HAUcmK9v0a6XdjpjpIDh4RvzVaD9004qWVmLBgQ_tPTPlwvpQh6DOdh6GTeu9yI9scy8IH-7RAOMcPa8SZlJrSdUqAQ2fuRXvVrMB8jtg Aug 05 10:20:14.539253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Domain-Id: None Aug 05 10:20:14.539253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Domain-Name: None Aug 05 10:20:14.539253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Identity-Status: Confirmed Aug 05 10:20:14.539253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Is-Admin-Project: True Aug 05 10:20:14.539253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 10:20:14.539253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Project-Domain-Id: default Aug 05 10:20:14.539253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Project-Domain-Name: Default Aug 05 10:20:14.539253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Project-Id: be89c43472bc49a2bd0e46cddf175958 Aug 05 10:20:14.539253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Project-Name: admin Aug 05 10:20:14.539253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Role: member,reader,admin Aug 05 10:20:14.539253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Roles: member,reader,admin Aug 05 10:20:14.540740 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_be89c43472bc49a2bd0e46cddf175958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/be89c43472bc49a2bd0e46cddf175958"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be89c43472bc49a2bd0e46cddf175958"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be89c43472bc49a2bd0e46cddf175958"}]}] Aug 05 10:20:14.540740 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Tenant: admin Aug 05 10:20:14.540740 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Tenant-Id: be89c43472bc49a2bd0e46cddf175958 Aug 05 10:20:14.540740 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Tenant-Name: admin Aug 05 10:20:14.540740 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-User: admin Aug 05 10:20:14.540740 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-User-Domain-Id: default Aug 05 10:20:14.540740 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-User-Domain-Name: Default Aug 05 10:20:14.540740 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-User-Id: 898d0645ae1e477983200e39184fa9ed Aug 05 10:20:14.540740 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-User-Name: admin Aug 05 10:20:14.540740 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: method: > Aug 05 10:20:14.540740 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: exception: Flavor 84 could not be found. Aug 05 10:20:14.540740 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: action_args: {'id': '84'} Aug 05 10:20:14.540740 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:20:14.540740 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:20:14.541640 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 10:20:14.541640 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 10:20:14.541640 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 10:20:14.541640 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 10:20:14.541640 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 10:20:14.541640 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 10:20:14.541640 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 10:20:14.541640 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 10:20:14.541640 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 10:20:14.541640 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:20:14.541640 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 10:20:14.541640 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 10:20:14.541640 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 05 10:20:14.541640 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 05 10:20:14.541640 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:20:14.541640 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 05 10:20:14.541640 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:20:14.541640 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:20:14.541640 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:20:14.542996 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:20:14.542996 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:20:14.542996 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:20:14.542996 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:20:14.542996 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 10:20:14.542996 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:20:14.542996 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 05 10:20:14.542996 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 05 10:20:14.542996 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:20:14.542996 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 05 10:20:14.542996 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:20:14.542996 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:20:14.542996 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:20:14.542996 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:20:14.542996 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:20:14.542996 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 05 10:20:14.542996 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 05 10:20:14.542996 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-eeab56de-4304-4026-9519-47429480ce0a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:20:14.544253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-eeab56de-4304-4026-9519-47429480ce0a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.453487 Aug 05 10:20:14.544253 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 22/44] 10.222.0.40 () {60 vars in 1190 bytes} [Fri Aug 5 10:20:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 455 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 10:20:14.554383 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-0f0ef2f1-9f50-41a8-8277-384e87bb4180 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:20:14.570296 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-0f0ef2f1-9f50-41a8-8277-384e87bb4180 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022211 Aug 05 10:20:14.570868 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 23/45] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Aug 5 10:20:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:20:14.582965 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-3deaa30c-fef4-4368-afce-be5cc69b84ae admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:20:14.600577 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-3deaa30c-fef4-4368-afce-be5cc69b84ae admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023371 Aug 05 10:20:14.601139 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 23/46] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Aug 5 10:20:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:20:14.610746 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-e15a8be2-de09-45b7-b6c8-c330385d997e admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:20:14.617198 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.wsgi [None req-e15a8be2-de09-45b7-b6c8-c330385d997e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 05 10:20:14.619347 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-e15a8be2-de09-45b7-b6c8-c330385d997e admin admin] Request method failure captured: Aug 05 10:20:14.619347 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 05 10:20:14.619347 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: Accept: application/json Aug 05 10:20:14.619347 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: Accept-Encoding: gzip, deflate Aug 05 10:20:14.619347 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: Connection: keep-alive Aug 05 10:20:14.619347 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: Content-Length: 0 Aug 05 10:20:14.619347 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: Host: 10.222.0.40 Aug 05 10:20:14.619347 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: Openstack-Api-Version: compute 2.90 Aug 05 10:20:14.619347 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: Openstack-System-Scope: None Aug 05 10:20:14.619347 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: User-Agent: python-novaclient Aug 05 10:20:14.619347 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Auth-Token: gAAAAABi7O7d-M_X3Tz3_RovZ3wIgcKv2KPu4sLvHXZaLuMFpnxgNfwNQ6uhQcb80ISQX_41Et7g6_HAUcmK9v0a6XdjpjpIDh4RvzVaD9004qWVmLBgQ_tPTPlwvpQh6DOdh6GTeu9yI9scy8IH-7RAOMcPa8SZlJrSdUqAQ2fuRXvVrMB8jtg Aug 05 10:20:14.619347 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Domain-Id: None Aug 05 10:20:14.619347 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Domain-Name: None Aug 05 10:20:14.619347 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Identity-Status: Confirmed Aug 05 10:20:14.619347 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Is-Admin-Project: True Aug 05 10:20:14.619347 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 10:20:14.619347 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Project-Domain-Id: default Aug 05 10:20:14.619347 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Project-Domain-Name: Default Aug 05 10:20:14.619347 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Project-Id: be89c43472bc49a2bd0e46cddf175958 Aug 05 10:20:14.619347 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Project-Name: admin Aug 05 10:20:14.619347 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Role: member,reader,admin Aug 05 10:20:14.619347 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Roles: member,reader,admin Aug 05 10:20:14.620844 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_be89c43472bc49a2bd0e46cddf175958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/be89c43472bc49a2bd0e46cddf175958"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be89c43472bc49a2bd0e46cddf175958"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be89c43472bc49a2bd0e46cddf175958"}]}] Aug 05 10:20:14.620844 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Tenant: admin Aug 05 10:20:14.620844 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Tenant-Id: be89c43472bc49a2bd0e46cddf175958 Aug 05 10:20:14.620844 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Tenant-Name: admin Aug 05 10:20:14.620844 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-User: admin Aug 05 10:20:14.620844 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-User-Domain-Id: default Aug 05 10:20:14.620844 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-User-Domain-Name: Default Aug 05 10:20:14.620844 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-User-Id: 898d0645ae1e477983200e39184fa9ed Aug 05 10:20:14.620844 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-User-Name: admin Aug 05 10:20:14.620844 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: method: > Aug 05 10:20:14.620844 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: exception: Flavor 84 could not be found. Aug 05 10:20:14.620844 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: action_args: {'id': '84'} Aug 05 10:20:14.620844 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:20:14.620844 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:20:14.621825 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 10:20:14.621825 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 10:20:14.621825 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 10:20:14.621825 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 10:20:14.621825 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 10:20:14.621825 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 10:20:14.621825 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 10:20:14.621825 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 10:20:14.621825 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 10:20:14.621825 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:20:14.621825 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 10:20:14.621825 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 10:20:14.621825 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 05 10:20:14.621825 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Aug 05 10:20:14.621825 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:20:14.621825 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Aug 05 10:20:14.621825 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:20:14.621825 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:20:14.621825 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:20:14.623262 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:20:14.623262 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:20:14.623262 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:20:14.623262 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:20:14.623262 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 10:20:14.623262 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:20:14.623262 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 05 10:20:14.623262 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Aug 05 10:20:14.623262 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:20:14.623262 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Aug 05 10:20:14.623262 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:20:14.623262 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:20:14.623262 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:20:14.623262 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:20:14.623262 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:20:14.623262 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 05 10:20:14.623262 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Aug 05 10:20:14.623262 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-e15a8be2-de09-45b7-b6c8-c330385d997e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:20:14.624899 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-e15a8be2-de09-45b7-b6c8-c330385d997e admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014096 Aug 05 10:20:14.624899 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 24/47] 10.222.0.40 () {60 vars in 1190 bytes} [Fri Aug 5 10:20:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 10:20:15.644865 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-3deaa30c-fef4-4368-afce-be5cc69b84ae admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:20:15.646255 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-3deaa30c-fef4-4368-afce-be5cc69b84ae admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001621 Aug 05 10:20:15.646645 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 24/48] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 5 10:20:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:20:16.269446 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-28362790-1097-41a6-8665-c89069d1c386 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:20:16.275899 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.wsgi [None req-28362790-1097-41a6-8665-c89069d1c386 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 05 10:20:16.277577 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-28362790-1097-41a6-8665-c89069d1c386 admin admin] Request method failure captured: Aug 05 10:20:16.277577 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 05 10:20:16.277577 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: Accept: application/json Aug 05 10:20:16.277577 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: Accept-Encoding: gzip, deflate Aug 05 10:20:16.277577 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: Connection: keep-alive Aug 05 10:20:16.277577 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: Content-Length: 0 Aug 05 10:20:16.277577 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: Host: 10.222.0.40 Aug 05 10:20:16.277577 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: Openstack-Api-Version: compute 2.90 Aug 05 10:20:16.277577 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: Openstack-System-Scope: None Aug 05 10:20:16.277577 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: User-Agent: python-novaclient Aug 05 10:20:16.277577 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Auth-Token: gAAAAABi7O7fGIhvAQ5jEmNj88bTH7LKWJ4InjJ2n3CbK8wh0rOFqUjENuxqWVsxgMvY9KG-OE7GXnm6cwUJIgD9PfKdwas_lJNbrC_RnS6pLMbLq3yvlepLW4ZbQc_L88_FUzYXFB4g7-4_2XkfE77JlJ3h2v5w1cwX-BO16TYr2ubyUZYIANM Aug 05 10:20:16.277577 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Domain-Id: None Aug 05 10:20:16.277577 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Domain-Name: None Aug 05 10:20:16.277577 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Identity-Status: Confirmed Aug 05 10:20:16.277577 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Is-Admin-Project: True Aug 05 10:20:16.277577 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 10:20:16.277577 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Project-Domain-Id: default Aug 05 10:20:16.277577 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Project-Domain-Name: Default Aug 05 10:20:16.277577 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Project-Id: be89c43472bc49a2bd0e46cddf175958 Aug 05 10:20:16.277577 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Project-Name: admin Aug 05 10:20:16.277577 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Role: member,reader,admin Aug 05 10:20:16.277577 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Roles: member,reader,admin Aug 05 10:20:16.279211 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_be89c43472bc49a2bd0e46cddf175958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/be89c43472bc49a2bd0e46cddf175958"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be89c43472bc49a2bd0e46cddf175958"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be89c43472bc49a2bd0e46cddf175958"}]}] Aug 05 10:20:16.279211 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Tenant: admin Aug 05 10:20:16.279211 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Tenant-Id: be89c43472bc49a2bd0e46cddf175958 Aug 05 10:20:16.279211 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-Tenant-Name: admin Aug 05 10:20:16.279211 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-User: admin Aug 05 10:20:16.279211 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-User-Domain-Id: default Aug 05 10:20:16.279211 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-User-Domain-Name: Default Aug 05 10:20:16.279211 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-User-Id: 898d0645ae1e477983200e39184fa9ed Aug 05 10:20:16.279211 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: X-User-Name: admin Aug 05 10:20:16.279211 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: method: > Aug 05 10:20:16.279211 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: exception: Flavor 451 could not be found. Aug 05 10:20:16.279211 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: action_args: {'id': '451'} Aug 05 10:20:16.279211 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:20:16.279211 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:20:16.280245 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 10:20:16.280245 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 10:20:16.280245 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 10:20:16.280245 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 10:20:16.280245 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 10:20:16.280245 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 10:20:16.280245 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 10:20:16.280245 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 10:20:16.280245 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 10:20:16.280245 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:20:16.280245 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 10:20:16.280245 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 10:20:16.280245 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 05 10:20:16.280245 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Aug 05 10:20:16.280245 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:20:16.280245 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Aug 05 10:20:16.280245 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:20:16.280245 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:20:16.280245 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:20:16.282127 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:20:16.282127 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:20:16.282127 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:20:16.282127 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:20:16.282127 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 10:20:16.282127 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:20:16.282127 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 05 10:20:16.282127 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Aug 05 10:20:16.282127 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:20:16.282127 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Aug 05 10:20:16.282127 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:20:16.282127 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:20:16.282127 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:20:16.282127 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:20:16.282127 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:20:16.282127 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 05 10:20:16.282127 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Aug 05 10:20:16.282127 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-28362790-1097-41a6-8665-c89069d1c386 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:20:16.284089 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-28362790-1097-41a6-8665-c89069d1c386 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.494752 Aug 05 10:20:16.284089 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 25/49] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Aug 5 10:20:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 496 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 10:20:16.294758 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-e79b4fc7-8788-44c7-b70f-2ff1796d4df1 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:20:16.310635 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-e79b4fc7-8788-44c7-b70f-2ff1796d4df1 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019670 Aug 05 10:20:16.311201 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 25/50] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Aug 5 10:20:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:20:16.320762 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-7adbdd06-12a5-4612-8e37-211524eb8dda admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:20:16.336776 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-7adbdd06-12a5-4612-8e37-211524eb8dda admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019481 Aug 05 10:20:16.337316 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 26/51] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Aug 5 10:20:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:20:16.347254 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-66d8bbb5-00c7-4c5b-b16a-3eed6f77d06a admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:20:16.352784 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.wsgi [None req-66d8bbb5-00c7-4c5b-b16a-3eed6f77d06a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 05 10:20:16.354309 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-66d8bbb5-00c7-4c5b-b16a-3eed6f77d06a admin admin] Request method failure captured: Aug 05 10:20:16.354309 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 05 10:20:16.354309 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: Accept: application/json Aug 05 10:20:16.354309 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: Accept-Encoding: gzip, deflate Aug 05 10:20:16.354309 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: Connection: keep-alive Aug 05 10:20:16.354309 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: Content-Length: 0 Aug 05 10:20:16.354309 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: Host: 10.222.0.40 Aug 05 10:20:16.354309 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: Openstack-Api-Version: compute 2.90 Aug 05 10:20:16.354309 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: Openstack-System-Scope: None Aug 05 10:20:16.354309 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: User-Agent: python-novaclient Aug 05 10:20:16.354309 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Auth-Token: gAAAAABi7O7fGIhvAQ5jEmNj88bTH7LKWJ4InjJ2n3CbK8wh0rOFqUjENuxqWVsxgMvY9KG-OE7GXnm6cwUJIgD9PfKdwas_lJNbrC_RnS6pLMbLq3yvlepLW4ZbQc_L88_FUzYXFB4g7-4_2XkfE77JlJ3h2v5w1cwX-BO16TYr2ubyUZYIANM Aug 05 10:20:16.354309 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Domain-Id: None Aug 05 10:20:16.354309 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Domain-Name: None Aug 05 10:20:16.354309 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Identity-Status: Confirmed Aug 05 10:20:16.354309 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Is-Admin-Project: True Aug 05 10:20:16.354309 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 10:20:16.354309 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Project-Domain-Id: default Aug 05 10:20:16.354309 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Project-Domain-Name: Default Aug 05 10:20:16.354309 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Project-Id: be89c43472bc49a2bd0e46cddf175958 Aug 05 10:20:16.354309 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Project-Name: admin Aug 05 10:20:16.354309 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Role: member,reader,admin Aug 05 10:20:16.354309 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Roles: member,reader,admin Aug 05 10:20:16.356038 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_be89c43472bc49a2bd0e46cddf175958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/be89c43472bc49a2bd0e46cddf175958"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be89c43472bc49a2bd0e46cddf175958"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be89c43472bc49a2bd0e46cddf175958"}]}] Aug 05 10:20:16.356038 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Tenant: admin Aug 05 10:20:16.356038 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Tenant-Id: be89c43472bc49a2bd0e46cddf175958 Aug 05 10:20:16.356038 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-Tenant-Name: admin Aug 05 10:20:16.356038 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-User: admin Aug 05 10:20:16.356038 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-User-Domain-Id: default Aug 05 10:20:16.356038 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-User-Domain-Name: Default Aug 05 10:20:16.356038 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-User-Id: 898d0645ae1e477983200e39184fa9ed Aug 05 10:20:16.356038 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: X-User-Name: admin Aug 05 10:20:16.356038 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: method: > Aug 05 10:20:16.356038 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: exception: Flavor 451 could not be found. Aug 05 10:20:16.356038 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: action_args: {'id': '451'} Aug 05 10:20:16.356038 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:20:16.356038 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:20:16.356998 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 10:20:16.356998 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 10:20:16.356998 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 10:20:16.356998 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 10:20:16.356998 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 10:20:16.356998 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 10:20:16.356998 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 10:20:16.356998 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 10:20:16.356998 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 10:20:16.356998 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:20:16.356998 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 10:20:16.356998 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 10:20:16.356998 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 05 10:20:16.356998 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 05 10:20:16.356998 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:20:16.356998 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 05 10:20:16.356998 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:20:16.356998 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:20:16.356998 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:20:16.358265 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:20:16.358265 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:20:16.358265 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:20:16.358265 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:20:16.358265 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 10:20:16.358265 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:20:16.358265 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 05 10:20:16.358265 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 05 10:20:16.358265 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:20:16.358265 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 05 10:20:16.358265 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:20:16.358265 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:20:16.358265 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:20:16.358265 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:20:16.358265 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:20:16.358265 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 05 10:20:16.358265 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 05 10:20:16.358265 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-66d8bbb5-00c7-4c5b-b16a-3eed6f77d06a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:20:16.359523 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-66d8bbb5-00c7-4c5b-b16a-3eed6f77d06a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012386 Aug 05 10:20:16.359735 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 26/52] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Aug 5 10:20:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 10:20:17.377291 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-7adbdd06-12a5-4612-8e37-211524eb8dda admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:20:17.378654 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-7adbdd06-12a5-4612-8e37-211524eb8dda admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005537 Aug 05 10:20:17.379093 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 27/53] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 5 10:20:17 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:20:17.947339 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-79d06771-783b-4fbf-bc2f-93151f2eb078 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:20:17.969209 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-79d06771-783b-4fbf-bc2f-93151f2eb078 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.451714 Aug 05 10:20:17.969714 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 27/54] 10.222.0.40 () {64 vars in 1235 bytes} [Fri Aug 5 10:20:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 10:20:18.994333 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-7adbdd06-12a5-4612-8e37-211524eb8dda admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:20:18.995381 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-7adbdd06-12a5-4612-8e37-211524eb8dda admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Aug 05 10:20:18.995764 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 28/55] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 5 10:20:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:20:19.568759 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-fcbe8933-0368-4a2b-9f48-286f8b0dcdd3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:20:19.591267 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-fcbe8933-0368-4a2b-9f48-286f8b0dcdd3 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.446397 Aug 05 10:20:19.591846 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 28/56] 10.222.0.40 () {64 vars in 1235 bytes} [Fri Aug 5 10:20:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 10:20:20.616842 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-7adbdd06-12a5-4612-8e37-211524eb8dda admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:20:20.617859 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-7adbdd06-12a5-4612-8e37-211524eb8dda admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 05 10:20:20.618260 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 29/57] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 5 10:20:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:20:21.189152 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-bf6a021c-28b2-4701-9d89-0688706f8b87 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:20:21.209795 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-bf6a021c-28b2-4701-9d89-0688706f8b87 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.455161 Aug 05 10:20:21.210328 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 29/58] 10.222.0.40 () {64 vars in 1235 bytes} [Fri Aug 5 10:20:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 10:20:22.196944 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-7adbdd06-12a5-4612-8e37-211524eb8dda admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:20:22.197958 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-7adbdd06-12a5-4612-8e37-211524eb8dda admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 05 10:20:22.198382 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 30/59] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 5 10:20:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:20:22.775172 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-4a91a2b7-5b2f-4e7d-a90c-bf80814b2304 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:20:22.797528 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-4a91a2b7-5b2f-4e7d-a90c-bf80814b2304 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.459834 Aug 05 10:20:22.798077 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 30/60] 10.222.0.40 () {64 vars in 1235 bytes} [Fri Aug 5 10:20:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 10:20:23.782068 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-7adbdd06-12a5-4612-8e37-211524eb8dda admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:20:23.783109 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-7adbdd06-12a5-4612-8e37-211524eb8dda admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 05 10:20:23.783503 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 31/61] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 5 10:20:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:20:24.350085 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-eefe0e89-011a-4204-aadc-243b84a1c5f4 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:20:24.370695 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-eefe0e89-011a-4204-aadc-243b84a1c5f4 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.450747 Aug 05 10:20:24.371296 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 31/62] 10.222.0.40 () {60 vars in 1202 bytes} [Fri Aug 5 10:20:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 10:21:16.418353 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-7adbdd06-12a5-4612-8e37-211524eb8dda admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:21:16.419351 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-7adbdd06-12a5-4612-8e37-211524eb8dda admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 05 10:21:16.419747 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 32/63] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 5 10:21:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:21:16.433554 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:21:16.870630 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-6f2a0c71-cf53-4f71-92ee-f181400b157f admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:21:16.891390 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-6f2a0c71-cf53-4f71-92ee-f181400b157f admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.464828 Aug 05 10:21:16.891922 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 32/64] 10.222.0.40 () {60 vars in 1292 bytes} [Fri Aug 5 10:21:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:21:16.914161 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG dbcounter [-] [103124] Writing DB stats nova_api:SELECT=14 {{(pid=103124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:21:16.917865 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-8baf809f-34c7-4ba1-8430-9ad2975bd2bb admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:21:16.925934 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-8baf809f-34c7-4ba1-8430-9ad2975bd2bb admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013307 Aug 05 10:21:16.926431 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 33/65] 10.222.0.40 () {60 vars in 1283 bytes} [Fri Aug 5 10:21:16 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:21:16.938434 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-b6d23db6-c179-42ee-a06d-0264a1f018e2 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:21:16.946846 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-b6d23db6-c179-42ee-a06d-0264a1f018e2 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012042 Aug 05 10:21:16.947404 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 33/66] 10.222.0.40 () {60 vars in 1286 bytes} [Fri Aug 5 10:21:16 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:21:16.959224 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-572cc8eb-08ab-424e-b0f0-850d8b4916f3 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:21:16.967034 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-572cc8eb-08ab-424e-b0f0-850d8b4916f3 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011787 Aug 05 10:21:16.967578 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 34/67] 10.222.0.40 () {60 vars in 1286 bytes} [Fri Aug 5 10:21:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:21:16.979106 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-f3fb7545-4fdb-4043-8496-964f94fb3cef admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:21:16.987041 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-f3fb7545-4fdb-4043-8496-964f94fb3cef admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011202 Aug 05 10:21:16.987567 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 34/68] 10.222.0.40 () {60 vars in 1283 bytes} [Fri Aug 5 10:21:16 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:24:09.678044 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-572cc8eb-08ab-424e-b0f0-850d8b4916f3 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:24:09.679034 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-572cc8eb-08ab-424e-b0f0-850d8b4916f3 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 05 10:24:09.679434 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 35/69] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 5 10:24:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:24:09.819054 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_api:SELECT=6 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:24:10.005344 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-a7aa5a22-8d84-44c0-a6b9-5ef45c79e47c admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:24:10.009000 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 10:24:10.009000 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: warnings.warn(msg) Aug 05 10:24:10.010603 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-a7aa5a22-8d84-44c0-a6b9-5ef45c79e47c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:24:10.011271 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-a7aa5a22-8d84-44c0-a6b9-5ef45c79e47c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:24:10.011888 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-a7aa5a22-8d84-44c0-a6b9-5ef45c79e47c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:24:10.012989 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-a7aa5a22-8d84-44c0-a6b9-5ef45c79e47c admin admin] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:24:10.013579 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-a7aa5a22-8d84-44c0-a6b9-5ef45c79e47c admin admin] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:24:10.014167 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-a7aa5a22-8d84-44c0-a6b9-5ef45c79e47c admin admin] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:24:10.050502 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-a7aa5a22-8d84-44c0-a6b9-5ef45c79e47c admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.233115 Aug 05 10:24:10.051081 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 35/70] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Aug 5 10:24:09 2022] GET /compute/v2.1/os-services => generated 794 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 10:24:10.889447 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-572cc8eb-08ab-424e-b0f0-850d8b4916f3 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:24:10.890497 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-572cc8eb-08ab-424e-b0f0-850d8b4916f3 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 05 10:24:10.890915 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 36/71] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 5 10:24:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:24:11.086083 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-d404a3a3-b1ed-4d0a-a73b-a9986b5f4985 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:24:11.088621 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 10:24:11.088621 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: warnings.warn(msg) Aug 05 10:24:11.089660 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-d404a3a3-b1ed-4d0a-a73b-a9986b5f4985 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:24:11.090123 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-d404a3a3-b1ed-4d0a-a73b-a9986b5f4985 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:24:11.090546 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-d404a3a3-b1ed-4d0a-a73b-a9986b5f4985 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:24:11.091269 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-d404a3a3-b1ed-4d0a-a73b-a9986b5f4985 admin admin] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:24:11.091704 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-d404a3a3-b1ed-4d0a-a73b-a9986b5f4985 admin admin] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:24:11.092109 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-d404a3a3-b1ed-4d0a-a73b-a9986b5f4985 admin admin] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:24:11.111216 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-d404a3a3-b1ed-4d0a-a73b-a9986b5f4985 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.081650 Aug 05 10:24:11.111760 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 36/72] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Aug 5 10:24:11 2022] GET /compute/v2.1/os-services => generated 794 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 10:24:22.370618 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-572cc8eb-08ab-424e-b0f0-850d8b4916f3 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:24:22.372002 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-572cc8eb-08ab-424e-b0f0-850d8b4916f3 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001889 Aug 05 10:24:22.372545 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 37/73] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 5 10:24:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:24:22.517536 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_cell0:SELECT=4 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:24:22.518255 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_cell1:SELECT=4 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:24:22.518933 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_api:SELECT=8 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:24:22.570277 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-c81971be-c4a1-443f-85aa-fed96eb56a3e admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:24:22.573070 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 10:24:22.573070 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: warnings.warn(msg) Aug 05 10:24:22.574171 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-c81971be-c4a1-443f-85aa-fed96eb56a3e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:24:22.574644 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-c81971be-c4a1-443f-85aa-fed96eb56a3e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:24:22.575095 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-c81971be-c4a1-443f-85aa-fed96eb56a3e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:24:22.575801 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-c81971be-c4a1-443f-85aa-fed96eb56a3e admin admin] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:24:22.576235 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-c81971be-c4a1-443f-85aa-fed96eb56a3e admin admin] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:24:22.576641 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-c81971be-c4a1-443f-85aa-fed96eb56a3e admin admin] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:24:22.601120 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-c81971be-c4a1-443f-85aa-fed96eb56a3e admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.087967 Aug 05 10:24:22.601663 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 37/74] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Aug 5 10:24:22 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 10:24:23.416391 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-572cc8eb-08ab-424e-b0f0-850d8b4916f3 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:24:23.417394 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-572cc8eb-08ab-424e-b0f0-850d8b4916f3 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 05 10:24:23.417781 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 38/75] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 5 10:24:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:24:23.607472 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-794d937f-d5a9-488b-9d6a-f60baada6999 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:24:23.609935 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 10:24:23.609935 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: warnings.warn(msg) Aug 05 10:24:23.611070 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-794d937f-d5a9-488b-9d6a-f60baada6999 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:24:23.611541 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-794d937f-d5a9-488b-9d6a-f60baada6999 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:24:23.611965 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-794d937f-d5a9-488b-9d6a-f60baada6999 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:24:23.612698 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-794d937f-d5a9-488b-9d6a-f60baada6999 admin admin] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:24:23.613140 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-794d937f-d5a9-488b-9d6a-f60baada6999 admin admin] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:24:23.613556 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-794d937f-d5a9-488b-9d6a-f60baada6999 admin admin] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:24:23.635928 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-794d937f-d5a9-488b-9d6a-f60baada6999 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.082752 Aug 05 10:24:23.636503 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 38/76] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Aug 5 10:24:23 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:25:21.061797 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: Fri Aug 5 10:25:21 2022 - graceful shutdown triggered... Aug 05 10:25:21.062646 dv-cinder-815582-15-iscsi devstack@n-api.service[103123]: Gracefully killing worker 1 (pid: 103123)... Aug 05 10:25:21.062380 dv-cinder-815582-15-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 05 10:25:21.064204 dv-cinder-815582-15-iscsi devstack@n-api.service[103124]: Gracefully killing worker 2 (pid: 103124)... Aug 05 10:25:22.062491 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: worker 1 buried after 1 seconds Aug 05 10:25:22.062491 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: worker 2 buried after 1 seconds Aug 05 10:25:22.062491 dv-cinder-815582-15-iscsi devstack@n-api.service[103122]: goodbye to uWSGI. Aug 05 10:25:22.065074 dv-cinder-815582-15-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 05 10:25:22.065824 dv-cinder-815582-15-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 05 10:25:22.069699 dv-cinder-815582-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 05 10:25:22.079645 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 05 10:25:22.082578 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 10:25:22 2022] *** Aug 05 10:25:22.082578 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 10:25:22.082578 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 10:25:22.082578 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: nodename: dv-cinder-815582-15-iscsi Aug 05 10:25:22.082578 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: machine: x86_64 Aug 05 10:25:22.082578 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: clock source: unix Aug 05 10:25:22.082578 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: pcre jit disabled Aug 05 10:25:22.082578 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: detected number of CPU cores: 4 Aug 05 10:25:22.082578 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: current working directory: / Aug 05 10:25:22.082578 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: detected binary path: /usr/bin/uwsgi-core Aug 05 10:25:22.082578 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: your processes number limit is 47680 Aug 05 10:25:22.082578 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: your memory page size is 4096 bytes Aug 05 10:25:22.082578 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: detected max file descriptor number: 2048 Aug 05 10:25:22.082578 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: lock engine: pthread robust mutexes Aug 05 10:25:22.083562 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: thunder lock: enabled Aug 05 10:25:22.083562 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 05 10:25:22.083562 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 10:25:22.123191 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: Python main interpreter initialized at 0x5574911649c0 Aug 05 10:25:22.123191 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: python threads support enabled Aug 05 10:25:22.123191 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: your server socket listen backlog is limited to 100 connections Aug 05 10:25:22.123191 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: your mercy for graceful operations on workers is 90 seconds Aug 05 10:25:22.123623 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 10:25:22.123623 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: *** Operational MODE: preforking *** Aug 05 10:25:22.123946 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: *** uWSGI is running in multiple interpreter mode *** Aug 05 10:25:22.123946 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: spawned uWSGI master process (pid: 117815) Aug 05 10:25:22.124172 dv-cinder-815582-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 05 10:25:22.125005 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: spawned uWSGI worker 1 (pid: 117831, cores: 1) Aug 05 10:25:22.126443 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: spawned uWSGI worker 2 (pid: 117832, cores: 1) Aug 05 10:25:22.126443 dv-cinder-815582-15-iscsi devstack@n-api.service[117815]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 10:25:22.784520 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 10:25:22.785153 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 10:25:23.918399 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 10:25:23.918399 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: from cryptography.utils import int_from_bytes Aug 05 10:25:23.919050 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 10:25:23.919050 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: from cryptography.utils import int_from_bytes Aug 05 10:25:23.989248 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 10:25:23.989248 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: from cryptography.utils import int_from_bytes Aug 05 10:25:23.989895 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 10:25:23.989895 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: from cryptography.utils import int_from_bytes Aug 05 10:25:26.231265 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 10:25:26.231869 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 10:25:26.232061 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 10:25:26.232466 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 10:25:26.232723 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 10:25:26.233109 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.233434 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.233745 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.234065 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.234377 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.234687 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.235033 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.235355 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.235679 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.235934 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.236278 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.236628 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-15-iscsi {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.236949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.237253 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.237557 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.237874 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.238171 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.239108 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.239108 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.239528 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.241120 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.241120 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.241120 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.241120 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.241948 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.241948 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.241948 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.243681 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.243681 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.243681 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.243681 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-15-iscsi {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.243681 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.243681 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.244208 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.244404 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.244707 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.245025 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.245336 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.245659 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.245975 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.246317 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.246635 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.246933 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.247289 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.247589 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.247893 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.248190 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.248505 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.248805 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.249103 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.249352 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.249656 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.249974 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.250277 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.250593 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.250837 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.251111 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.251429 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.251750 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.252055 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.252712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.253118 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.253431 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.253739 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.254046 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.254354 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.254665 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.255006 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.255321 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.255642 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.255952 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.256270 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.256666 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.256914 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.257219 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.257559 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.257874 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.258179 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.258499 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.258817 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.259148 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.259451 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.259822 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.260142 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.260477 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.260786 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.261035 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.261334 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.261637 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.261952 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.262254 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.262558 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.262864 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.263187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.263488 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.263792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.264097 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.264401 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.264707 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.265007 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.265310 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.265610 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.265909 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.266224 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.266540 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.266841 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.267171 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.267472 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.267814 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.268134 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.268438 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.268738 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.269056 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.269358 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.269660 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.269974 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.270278 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.270585 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.270925 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.271215 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.271519 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.271831 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.272132 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.272431 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.272730 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.273029 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.273329 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.273631 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.273928 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.274263 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.274519 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.274836 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.275707 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.275707 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.276145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.276145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.276482 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.276758 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.277091 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.277434 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.277746 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.278076 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.278404 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.278719 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.279049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.279362 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.279683 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.279989 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.280297 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.280609 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.280921 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.281235 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.281563 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.281865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.282177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.282586 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.282833 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.283165 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.283529 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.284040 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.284351 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.284691 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.285036 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.285343 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.285665 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.285985 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.286293 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.286600 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.287631 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.287752 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.287984 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.288294 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.288609 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.288920 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.289226 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.289531 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.289837 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.290142 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.290313 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 10:25:26.290749 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.290863 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 10:25:26.290980 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.291098 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.291188 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 10:25:26.291408 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.291608 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 10:25:26.291710 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.291871 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 10:25:26.292019 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.292256 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.292413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.292600 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.292740 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.292902 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.293002 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.293219 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.293496 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.293599 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.293724 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.294100 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.294100 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.294280 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.294373 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.294607 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.294721 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.294889 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.295115 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.295633 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.295740 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.295827 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.295911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.295911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.296067 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.296197 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.296290 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-15-iscsi {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.296502 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.296601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.296805 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.296896 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.297114 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.297206 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.297422 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.297523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.297723 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.297829 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.298043 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.298141 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.298348 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.298438 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.298649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.298845 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.298983 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.299214 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.299318 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.299592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.299750 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.299902 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.299995 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.300212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.300310 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.300518 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.300624 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.300825 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.300918 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.301132 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.301223 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.301451 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.301557 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.301761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.301851 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.302067 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.302211 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.302397 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.302502 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-15-iscsi {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.302728 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.302828 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.303056 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.303160 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.303374 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.303487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.303697 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.303801 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.304007 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.304127 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.304314 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.304444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.304620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.304721 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.304920 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.305021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.305229 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.305347 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.305536 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.305648 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.305828 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.305929 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.306128 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.306217 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.306430 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.306519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.306731 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.306824 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.307055 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.307160 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.307358 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.307456 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.307672 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.307762 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.307973 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.308069 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.308272 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.308363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.308519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.308619 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.308819 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.308917 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.309134 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.309233 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.309451 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.309542 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.309796 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.309901 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.310041 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.310146 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.310293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.310440 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.310606 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.310761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.310938 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.311115 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.311281 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.311422 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.311562 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.311711 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.311860 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.311999 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.312156 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.312302 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.312449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.312590 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.312738 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.312883 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.313034 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.313194 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.313341 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.313484 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.313630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.313863 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.314015 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.314157 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.314307 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.314566 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.314796 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.315009 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.315159 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.315372 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.315694 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.315833 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.315980 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.316135 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.316275 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.316424 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.316567 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.317291 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.317441 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.317597 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.317744 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.317894 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.318078 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.318177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.318272 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.318366 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.318451 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.318534 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.318617 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.318708 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.318805 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.318879 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.319030 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.319120 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.319206 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.319302 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.319487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.319589 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.319795 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.319925 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.320094 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.320217 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.320413 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.320542 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.320729 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.320860 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.321031 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.321156 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.321338 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.321467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.321642 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.321770 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.321941 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.322073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.322244 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.322361 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.322546 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.322665 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.322847 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.323065 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.323191 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.323311 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.323467 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.323594 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.323767 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.323916 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.324199 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.324505 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.324817 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.325128 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.325238 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.325433 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.325533 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.325743 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.325859 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.326042 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.326219 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.326354 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.326454 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.326658 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.326761 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.327000 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.327309 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.327615 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.327882 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.327984 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.328251 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.328414 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.328534 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.328652 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.328864 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.328971 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.329215 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.329354 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.329521 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.329617 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.329845 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.329951 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.330147 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.330240 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.330496 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.330593 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.330988 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.331108 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.331203 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.331285 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.331451 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.331552 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.331753 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.331845 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.332052 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.332145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.332349 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.332450 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.332652 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.332761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.332947 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.333041 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.333230 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.333318 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.333526 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.333625 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.333821 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.333910 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.334177 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.334280 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.334410 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.334501 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.334724 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.334814 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.335073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.335183 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.335381 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.335486 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.335681 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.335841 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.335984 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.336152 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.336287 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.336389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 10:25:26.336592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.336684 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.336897 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.337000 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.337220 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.337314 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.337527 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.337626 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.337833 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.337935 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.338141 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.338234 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.338440 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.338533 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.338745 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.338845 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.339095 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.339257 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.339407 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.339662 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.339828 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.339996 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.340135 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.340303 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.340437 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.340615 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.340767 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.340930 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.341060 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.341248 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.341387 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.341558 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.341702 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.341869 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.342007 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.342183 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.342331 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.342484 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.342636 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.342772 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.342935 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.343100 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.343192 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.343401 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.343491 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.343709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.343806 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.344011 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.344107 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.344318 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.344441 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.344620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.344748 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.344925 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.345017 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.345229 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.345334 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.345528 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.345649 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.345831 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.346005 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.346209 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.346318 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.346573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.346680 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.346807 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.347006 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.347150 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.347240 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.347451 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.347551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.347771 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.347861 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.348076 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.348181 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.348379 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.348476 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.348680 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.348770 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.348977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.349067 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.349314 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.349411 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.349613 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.349710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.349921 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.350010 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.350228 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.350326 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.350536 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.350626 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.350926 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.351032 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.351341 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.351439 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.352164 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.352266 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.352344 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.352425 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.352496 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.352572 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.352649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.352725 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.352825 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.352924 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.353129 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.353216 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.353427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.353514 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.353734 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.353882 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.354039 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.354125 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.354463 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.354558 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.354639 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.354718 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.354983 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.355076 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.355249 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.355341 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.355549 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.355630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.355868 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.355963 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.356276 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.356377 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.356593 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.356900 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.357208 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.357513 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.357813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.358119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.358417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.358729 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.359080 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.359271 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.359431 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.359598 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.359756 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.360003 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.360167 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.360314 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.360465 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.360625 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.360778 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.360946 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.361168 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.361324 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.361485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.361685 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.361841 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.361986 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.362129 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.362129 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.362409 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.362566 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.362719 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.362865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.363049 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.363196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.363346 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.363500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.363674 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.363820 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.364117 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.364279 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.364437 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.364591 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.364591 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.364863 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.365014 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.365165 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.365316 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.365459 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.365602 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.365761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.365913 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.366056 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.366211 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.366355 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.366516 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.366753 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.366937 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.367110 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.367269 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.367423 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.367576 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.367721 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.367881 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.368035 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.368179 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.368323 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.368465 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.368614 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.368759 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.368916 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.369060 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.369215 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.369361 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.369511 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.369666 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.369824 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.369967 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.370270 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.370576 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.370875 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.371058 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.371303 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.371452 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.371596 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.371739 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.371928 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.372093 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.372255 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.372400 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.372543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.372687 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.372829 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.372982 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.373134 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.373276 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.373419 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.373563 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.373706 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.373858 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.374003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.374163 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.374307 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.374456 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.374609 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.374840 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.375046 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.375209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.375353 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.375599 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.375759 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.375925 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.376076 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.376313 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.376494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.376838 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.377013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.377187 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.377437 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.377594 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.377745 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.377936 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.378164 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.378320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.378464 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.378623 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.378767 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.378974 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.379142 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.379287 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.379431 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.379575 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.379719 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.379871 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.380015 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.380165 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.380365 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.380526 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.380672 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.380872 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.381019 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.381162 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.381324 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.381550 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.381700 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.381853 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.381999 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.382142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.382286 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.382437 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.382437 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.382733 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.382949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.383104 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.383259 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.383405 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.383563 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.383715 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.383911 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.384059 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.384226 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.384384 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.384547 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.384692 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.384870 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.385078 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.385236 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.385475 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.385633 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.385784 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.385929 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.386081 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.386224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.386375 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.386724 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.387047 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.387217 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.387363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.387526 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.387681 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.387825 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.387968 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.388111 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.388260 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.388407 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.388726 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.388879 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.389024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.389174 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.389318 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.389475 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.389629 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.389782 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.389925 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.390075 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.390219 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.390369 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.390522 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.390665 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.390809 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.390989 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.391139 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.391298 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.391298 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.391685 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.391845 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.391997 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.392140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.392293 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.392436 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.392579 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.392724 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.392995 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.393183 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.393344 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.393344 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.393637 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.393781 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.393781 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.394065 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.394216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.394367 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.394510 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.394653 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.394802 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.394983 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.395134 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.395285 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.395427 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.395581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.395725 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.395947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.396094 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.396244 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.396389 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.396541 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.396691 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.396936 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.397107 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.397339 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.397496 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.397652 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.397794 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.397947 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.398091 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.398241 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.398393 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.398536 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.398724 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.398887 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.399072 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.399227 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.399378 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.399522 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.399685 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.399829 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.399979 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.400130 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.400283 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.400426 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.400577 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.400721 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.400871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.401015 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.401156 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.401306 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.401464 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.401625 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.401856 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.402004 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.402147 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.402476 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.402638 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.402784 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.402992 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.403144 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.403336 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.403498 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.403643 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.403643 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.403926 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.404110 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.404110 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.404392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.404535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.404987 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.405138 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.405283 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.405427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.405584 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.405732 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.405732 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.406032 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.406311 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.406475 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.406636 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.406780 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.406961 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.407124 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.407269 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.407269 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.407673 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.407828 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.407972 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.408125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.408297 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.408500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.408658 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.408809 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.408963 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.409107 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.409256 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.409406 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.409406 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.409730 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.409889 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.410033 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.410184 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.410337 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.410481 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.410630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.410790 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.410998 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.411148 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.411148 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.411433 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.411591 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.411751 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.412329 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.412480 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.412631 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.412798 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.412957 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.413108 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.413259 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.413402 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.413545 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.413687 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.413846 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.413990 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.414133 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.414276 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.414418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.414578 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.414738 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.414884 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.415074 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.415217 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.415217 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.415500 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.415659 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.415811 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.415963 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.416114 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.416263 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.416417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.416574 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.416717 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.416921 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.417078 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.417230 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.417387 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.417560 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.417803 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.417959 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.418105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.418248 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.418410 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.418562 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.418716 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.418868 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.419128 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.419288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.419447 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.419598 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.419748 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.419892 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.420034 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.420034 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.420320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.420462 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.420615 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.420757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.420906 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.421062 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.421215 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.421362 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.421512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.421664 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.421815 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.421971 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.422121 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.422265 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.422512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.422693 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.422846 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.423066 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.423227 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.423385 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.423541 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.423691 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.423691 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.424013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.424201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.424354 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.424503 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.424662 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.424901 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.425054 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.425204 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.425363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.425514 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.425671 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.425835 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.425993 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.426152 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.426303 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.426303 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.426623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.426783 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.426963 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.427120 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.427280 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.427431 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.427431 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.427724 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.427979 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.428146 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.428315 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.428471 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.428621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.428782 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.428932 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.429081 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.429245 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.429396 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.429396 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.429683 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.429839 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.430109 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.430281 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.430442 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.430603 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.430754 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.430938 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.431193 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.431357 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.431507 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.431658 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.431807 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.431957 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.432121 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.432273 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.432456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.432706 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.432862 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.433032 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.433195 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.433353 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.433510 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.433669 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.433828 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.433986 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.434146 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.434297 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.434446 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.434603 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.434755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.434953 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.435130 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.435292 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.435479 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.435640 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.435799 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.435964 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.436152 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.436152 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.436449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.436600 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.436756 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.436916 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.437073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.437235 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.437235 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.437537 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.437695 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.437862 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.438015 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.438189 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.438448 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.438613 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.438775 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.438949 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.439118 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.439290 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.439448 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.439607 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.439797 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.439950 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.439950 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.440253 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.440403 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.440553 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.440711 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.440869 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.441027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.441027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.441336 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.441487 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.441651 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.441802 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.441952 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.442111 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.442261 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.442426 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.442579 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.442579 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.443021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.443192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.443345 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.443516 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.443675 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.443826 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.443983 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.444134 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.444283 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.444446 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.444597 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.444746 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.444895 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.445044 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.445194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.445354 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.445521 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.445678 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.445844 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.445996 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.446153 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.446314 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.446472 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.446623 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.446773 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.446941 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.447174 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.447330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.447330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.447636 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.447788 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.447938 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.448097 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.448097 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.448425 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.448670 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.448831 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.448990 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.449150 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.449302 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.449460 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.449630 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.449790 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.449954 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.450105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.450256 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.450405 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.450564 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.450721 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.450880 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.451100 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.451262 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.451419 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.451572 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.451739 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.451903 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.452062 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.452212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.452360 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.452529 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.452748 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.452915 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.453155 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.453155 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.453462 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.453628 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.453789 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.453964 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.453964 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.454259 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.454409 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.454558 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.454722 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.454873 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.455046 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.455198 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.455427 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.455594 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.455758 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.455927 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.456084 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.456242 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.456399 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.456551 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.456710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.456864 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.457022 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.457181 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.457339 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.457499 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.457499 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.457800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.457962 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.458113 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.458276 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.458276 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.458583 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.458847 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.459049 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.459209 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.459209 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.459506 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.459667 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.459819 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.459980 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.460195 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.460359 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.460519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.460675 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.460832 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.460984 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.461133 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.461133 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.461428 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.461588 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.461746 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.461903 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.462065 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.462229 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.462387 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.462544 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.462701 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.462850 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.463023 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.463203 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.463429 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.463591 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.463749 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.463906 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.464067 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.464229 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.464379 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.464528 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.464686 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.464838 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.464996 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.465154 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.465306 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.465455 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.465613 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.465763 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.465921 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.466089 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.466241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.466390 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.466539 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.466697 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.466858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.467033 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.467186 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.467186 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.467511 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.467684 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.467844 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.467994 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.468206 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.468369 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.468520 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.468685 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.468685 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.469082 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.469246 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.469406 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.469555 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.469719 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.469870 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.470028 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.470196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.470346 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.470509 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.470667 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.470825 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.471022 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.471175 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.471325 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.471489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.471640 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.471790 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.471948 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.472106 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.472267 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.472427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.472579 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.472728 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.472885 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.473036 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.473199 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.473358 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.473604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.473770 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.473921 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.474071 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.474071 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.474071 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.474071 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.474071 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.474071 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.474071 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.475145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.475295 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.475452 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.475609 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.475768 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.475919 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.476081 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.476081 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.476451 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.476607 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.476758 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.476990 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.477143 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.477302 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.477453 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.477610 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.477610 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.477921 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.478079 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.478241 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.478408 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.478565 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.478723 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.478888 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.479111 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.479363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.479525 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.479684 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.479835 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.479995 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.480152 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.480311 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.480461 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.480622 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.480785 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.480785 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.481089 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.481254 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.481405 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.481555 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.481712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.481863 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.482022 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.482179 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.482337 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.482487 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.482655 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.482814 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.482984 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.483139 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.483299 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.483450 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.483626 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.483845 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.483999 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.484151 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.484301 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.484466 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.484628 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.484786 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.484937 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.485088 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.485237 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.485396 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.485554 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.485705 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.485861 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.486011 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.486168 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.486328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.486506 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.486506 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.486849 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.487074 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.487242 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.487400 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.487400 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.487693 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.487844 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.488001 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.488160 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.488160 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.488465 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.488626 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.488776 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.488925 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.489083 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.489083 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.489374 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.489474 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.489793 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.490104 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.490454 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.490632 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.490784 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.491004 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.491129 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.491333 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.491454 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.491659 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.491777 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.491942 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 10:25:26.492235 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.492568 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.492887 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.493202 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.493517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.493897 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.494141 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.494460 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.494771 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.495114 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.495424 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.495754 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.496344 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.496682 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.497116 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.497442 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.497780 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.498320 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.498637 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.499025 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.499343 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.499648 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.499960 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.500276 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.500590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.500899 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.501207 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.501519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.501830 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.502684 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.502684 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.503005 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.503134 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.503423 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.503762 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.504151 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.504465 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.504777 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.505092 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.505667 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.505978 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.506494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.506813 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.507188 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.507505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.507866 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.508324 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.508630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.508932 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.509240 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.509543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.509843 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.510163 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.510469 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.510768 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.511120 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.511424 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.512009 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.512355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.512668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.512993 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.513313 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.513625 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.513927 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.514249 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.514557 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.514859 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.515197 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.515505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.515807 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.516106 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.516567 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.516887 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.517185 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.517491 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.517905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.518405 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.518924 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.519263 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.519591 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.519876 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.520182 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.520485 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.520789 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.521090 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.521401 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.521702 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.522006 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.522307 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.522612 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.522930 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.523240 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.523541 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.523867 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.524168 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.524526 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.524840 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.525147 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.525467 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.525773 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.526080 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.526444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.526928 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.527533 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.527869 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.528188 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.528531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.528856 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.529161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.529476 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.529773 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.530096 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.530404 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.530708 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.531039 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.531386 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.531703 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.532012 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.532319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.532652 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.532957 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.533260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.533626 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.533899 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.534203 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.534597 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.534949 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.535308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.535627 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.535938 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.536250 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.536560 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.537375 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.537685 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.537993 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.538296 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.538605 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.539018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.539331 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.539634 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.540064 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.540370 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.540684 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.541000 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.541305 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.541620 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.541935 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.542241 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.542553 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.542999 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.543266 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.543683 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.543968 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.544228 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.544535 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.544835 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.545132 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.545435 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.545749 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.546052 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.546349 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.546646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.546971 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.547547 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.547695 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.547901 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.548200 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.548502 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.548801 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.549989 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.549989 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.550412 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.550412 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.550676 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.550966 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.551231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.551532 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.551829 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.552128 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.552862 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.553099 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.553363 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.553710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.554133 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.554333 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.554654 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.555043 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.555361 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.555596 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.555931 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.556217 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.556509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.556814 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.557119 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.557729 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.557729 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.558026 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.558297 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.558622 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.558966 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.559259 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.559579 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.560067 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.560546 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.560860 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.561166 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.561490 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.561796 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.562102 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.562404 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.562709 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.563040 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.563354 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.563658 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.563962 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.564339 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.564845 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.565129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.565442 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.565886 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.566210 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.566744 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.567047 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.567319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.567668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.567995 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.568307 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.568615 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.568917 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 10:25:26.569158 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 10:25:26.652527 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO dbcounter [None req-b98c56df-fb26-4066-b2d5-772ddee4aba4 None None] Registered counter for database nova_api Aug 05 10:25:26.673532 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_db.sqlalchemy.engines [None req-b98c56df-fb26-4066-b2d5-772ddee4aba4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 10:25:26.681235 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writer thread running {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 10:25:26.723556 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO dbcounter [None req-000b9fcd-be35-4623-8188-35cb11c820be None None] Registered counter for database nova_api Aug 05 10:25:26.738836 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.context [None req-b98c56df-fb26-4066-b2d5-772ddee4aba4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f636a431-9fc7-40b9-b93c-769f38c3c626(cell1) {{(pid=117832) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 10:25:26.742995 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b98c56df-fb26-4066-b2d5-772ddee4aba4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:25:26.743418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_db.sqlalchemy.engines [None req-000b9fcd-be35-4623-8188-35cb11c820be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 10:25:26.743572 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b98c56df-fb26-4066-b2d5-772ddee4aba4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:25:26.745056 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b98c56df-fb26-4066-b2d5-772ddee4aba4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:25:26.745791 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b98c56df-fb26-4066-b2d5-772ddee4aba4 None None] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:25:26.746241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b98c56df-fb26-4066-b2d5-772ddee4aba4 None None] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:25:26.748279 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b98c56df-fb26-4066-b2d5-772ddee4aba4 None None] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:25:26.750308 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO dbcounter [None req-b98c56df-fb26-4066-b2d5-772ddee4aba4 None None] Registered counter for database nova_cell0 Aug 05 10:25:26.750497 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writer thread running {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 10:25:26.754915 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO dbcounter [None req-b98c56df-fb26-4066-b2d5-772ddee4aba4 None None] Registered counter for database nova_cell1 Aug 05 10:25:26.762159 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_db.sqlalchemy.engines [None req-b98c56df-fb26-4066-b2d5-772ddee4aba4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 10:25:26.763948 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_db.sqlalchemy.engines [None req-b98c56df-fb26-4066-b2d5-772ddee4aba4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 10:25:26.768729 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writer thread running {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 10:25:26.807591 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.context [None req-000b9fcd-be35-4623-8188-35cb11c820be None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f636a431-9fc7-40b9-b93c-769f38c3c626(cell1) {{(pid=117831) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 10:25:26.811688 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-000b9fcd-be35-4623-8188-35cb11c820be None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:25:26.812170 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-000b9fcd-be35-4623-8188-35cb11c820be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:25:26.813740 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-000b9fcd-be35-4623-8188-35cb11c820be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:25:26.814461 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-000b9fcd-be35-4623-8188-35cb11c820be None None] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:25:26.814978 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-000b9fcd-be35-4623-8188-35cb11c820be None None] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:25:26.817016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-000b9fcd-be35-4623-8188-35cb11c820be None None] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:25:26.819082 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO dbcounter [None req-000b9fcd-be35-4623-8188-35cb11c820be None None] Registered counter for database nova_cell0 Aug 05 10:25:26.823260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO dbcounter [None req-000b9fcd-be35-4623-8188-35cb11c820be None None] Registered counter for database nova_cell1 Aug 05 10:25:26.830934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_db.sqlalchemy.engines [None req-000b9fcd-be35-4623-8188-35cb11c820be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 10:25:26.832483 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_db.sqlalchemy.engines [None req-000b9fcd-be35-4623-8188-35cb11c820be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 10:25:26.839415 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writer thread running {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 10:25:26.840703 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writer thread running {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 10:25:26.905157 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writer thread running {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 10:25:26.915939 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO dbcounter [None req-b98c56df-fb26-4066-b2d5-772ddee4aba4 None None] Registered counter for database nova_cell0 Aug 05 10:25:26.923030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_db.sqlalchemy.engines [None req-b98c56df-fb26-4066-b2d5-772ddee4aba4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 10:25:26.931044 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writer thread running {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 10:25:26.985254 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO dbcounter [None req-000b9fcd-be35-4623-8188-35cb11c820be None None] Registered counter for database nova_cell0 Aug 05 10:25:26.992546 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_db.sqlalchemy.engines [None req-000b9fcd-be35-4623-8188-35cb11c820be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 10:25:26.997582 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writer thread running {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 10:25:27.250118 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: WARNING keystonemiddleware.auth_token [None req-b98c56df-fb26-4066-b2d5-772ddee4aba4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 10:25:27.257482 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: WARNING keystonemiddleware.auth_token [None req-b98c56df-fb26-4066-b2d5-772ddee4aba4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 10:25:27.323280 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: WARNING keystonemiddleware.auth_token [None req-000b9fcd-be35-4623-8188-35cb11c820be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 10:25:27.331453 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: WARNING keystonemiddleware.auth_token [None req-000b9fcd-be35-4623-8188-35cb11c820be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 10:25:27.597634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: WARNING keystonemiddleware.auth_token [None req-b98c56df-fb26-4066-b2d5-772ddee4aba4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 10:25:27.604027 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: WARNING keystonemiddleware.auth_token [None req-b98c56df-fb26-4066-b2d5-772ddee4aba4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 10:25:27.610822 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5574911649c0 pid: 117832 (default app) Aug 05 10:25:27.696411 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: WARNING keystonemiddleware.auth_token [None req-000b9fcd-be35-4623-8188-35cb11c820be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 10:25:27.703063 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: WARNING keystonemiddleware.auth_token [None req-000b9fcd-be35-4623-8188-35cb11c820be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 10:25:27.710124 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5574911649c0 pid: 117831 (default app) Aug 05 10:26:03.899424 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:26:03.902378 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:26:03.903692 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:26:03.904956 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:26:05.559472 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-74f30bb4-8cb4-4ce1-a5ba-54140b3702bf tempest-VolumesGetTestJSON-1802773411 tempest-VolumesGetTestJSON-1802773411-project] Action: 'create', calling method: .version_select at 0x7f732d5c9e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-255784106", "metadata": {"Type": "work"}}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:26:06.945599 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-74f30bb4-8cb4-4ce1-a5ba-54140b3702bf tempest-VolumesGetTestJSON-1802773411 tempest-VolumesGetTestJSON-1802773411-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.067270 Aug 05 10:26:06.947800 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 1/1] 10.222.0.40 () {60 vars in 1156 bytes} [Fri Aug 5 10:26:03 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3071 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 05 10:26:07.440235 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-5ab7201c-902b-4a9f-a5ec-7a8efadcc272 tempest-VolumesGetTestJSON-1802773411 tempest-VolumesGetTestJSON-1802773411-project] Calling method '.version_select at 0x7f732d6ab940>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:07.485641 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=3 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:26:07.489842 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=3 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:26:07.493105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=3 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:26:07.495185 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=3 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:26:07.772730 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9ecaeea7-b4a3-4ee8-8323-9be5eeb7bde4 tempest-VolumesTestJSON-1330368677 tempest-VolumesTestJSON-1330368677-project] Calling method '.version_select at 0x7f732d445ca0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:07.864443 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9ecaeea7-b4a3-4ee8-8323-9be5eeb7bde4 tempest-VolumesTestJSON-1330368677 tempest-VolumesTestJSON-1330368677-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/92b13ee1-062d-44ee-9758-4ef49084aa75" status: 200 len: 350 microversion: 2.1 time: 0.097248 Aug 05 10:26:07.865016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 2/2] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 10:26:07 2022] GET /compute/v2.1/os-volumes/92b13ee1-062d-44ee-9758-4ef49084aa75 => generated 350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:26:07.933930 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-5ab7201c-902b-4a9f-a5ec-7a8efadcc272 tempest-VolumesGetTestJSON-1802773411 tempest-VolumesGetTestJSON-1802773411-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d508740b-32c4-4771-8f3c-acd9ec0b545a" status: 200 len: 353 microversion: 2.1 time: 0.973807 Aug 05 10:26:07.933930 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 1/3] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 10:26:06 2022] GET /compute/v2.1/os-volumes/d508740b-32c4-4771-8f3c-acd9ec0b545a => generated 353 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:26:07.947987 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2b064b4c-1c01-4812-9da6-e817db440f6c tempest-VolumesGetTestJSON-1802773411 tempest-VolumesGetTestJSON-1802773411-project] Calling method '.version_select at 0x7f732d464430>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:08.024301 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2b064b4c-1c01-4812-9da6-e817db440f6c tempest-VolumesGetTestJSON-1802773411 tempest-VolumesGetTestJSON-1802773411-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d508740b-32c4-4771-8f3c-acd9ec0b545a" status: 200 len: 353 microversion: 2.1 time: 0.081013 Aug 05 10:26:08.025206 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 3/4] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 10:26:07 2022] GET /compute/v2.1/os-volumes/d508740b-32c4-4771-8f3c-acd9ec0b545a => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:26:08.047727 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-24524f63-626f-4f61-9afe-27ecfb20ddd1 tempest-VolumesGetTestJSON-1802773411 tempest-VolumesGetTestJSON-1802773411-project] Calling method '.version_select at 0x7f732d4faca0>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:08.260476 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-24524f63-626f-4f61-9afe-27ecfb20ddd1 tempest-VolumesGetTestJSON-1802773411 tempest-VolumesGetTestJSON-1802773411-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/d508740b-32c4-4771-8f3c-acd9ec0b545a" status: 202 len: 0 microversion: 2.1 time: 0.218112 Aug 05 10:26:08.261092 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 2/5] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 5 10:26:08 2022] DELETE /compute/v2.1/os-volumes/d508740b-32c4-4771-8f3c-acd9ec0b545a => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:26:08.269504 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6445cc44-0206-49f3-84c1-4047979e75d0 tempest-VolumesGetTestJSON-1802773411 tempest-VolumesGetTestJSON-1802773411-project] Calling method '.version_select at 0x7f732d464af0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:08.632546 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6445cc44-0206-49f3-84c1-4047979e75d0 tempest-VolumesGetTestJSON-1802773411 tempest-VolumesGetTestJSON-1802773411-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d508740b-32c4-4771-8f3c-acd9ec0b545a" status: 200 len: 352 microversion: 2.1 time: 0.367208 Aug 05 10:26:08.633533 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 4/6] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 10:26:08 2022] GET /compute/v2.1/os-volumes/d508740b-32c4-4771-8f3c-acd9ec0b545a => generated 352 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:26:09.648327 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d7f79f4b-236e-499b-b230-1bec0cb4caaf tempest-VolumesGetTestJSON-1802773411 tempest-VolumesGetTestJSON-1802773411-project] Calling method '.version_select at 0x7f732d4fad30>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:09.720339 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-d7f79f4b-236e-499b-b230-1bec0cb4caaf tempest-VolumesGetTestJSON-1802773411 tempest-VolumesGetTestJSON-1802773411-project] HTTP exception thrown: Volume d508740b-32c4-4771-8f3c-acd9ec0b545a could not be found. Aug 05 10:26:09.727934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d7f79f4b-236e-499b-b230-1bec0cb4caaf tempest-VolumesGetTestJSON-1802773411 tempest-VolumesGetTestJSON-1802773411-project] Request method failure captured: Aug 05 10:26:09.727934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: GET /compute/v2.1/os-volumes/d508740b-32c4-4771-8f3c-acd9ec0b545a HTTP/1.1 Aug 05 10:26:09.727934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:26:09.727934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:26:09.727934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:26:09.727934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:26:09.727934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:26:09.727934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:26:09.727934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:26:09.727934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:26:09.727934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PA7TotsD5t4sLxwNl7QnqZgP8vBm_ZuHwzRv1phyNsTZPgokDjyZjJpdYBeEgVjalZz5ZZUkfTee_QkkAHKERbXTo2s-3w482vavDdD0e7MiTnkPHYv6h1DcCP4X_Fn4hnApbOMweV_YYht8fdkDM5TDqlGDVgiaIecq7yK9kRywfE Aug 05 10:26:09.727934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:26:09.727934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:26:09.727934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:26:09.727934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:26:09.727934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:26:09.727934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:26:09.727934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 78c1e92af310437db4b79bfed67fa76a Aug 05 10:26:09.727934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-VolumesGetTestJSON-1802773411 Aug 05 10:26:09.727934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:26:09.727934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:26:09.728968 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_78c1e92af310437db4b79bfed67fa76a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/78c1e92af310437db4b79bfed67fa76a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/78c1e92af310437db4b79bfed67fa76a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/78c1e92af310437db4b79bfed67fa76a"}]}] Aug 05 10:26:09.728968 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-VolumesGetTestJSON-1802773411 Aug 05 10:26:09.728968 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 78c1e92af310437db4b79bfed67fa76a Aug 05 10:26:09.728968 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-VolumesGetTestJSON-1802773411 Aug 05 10:26:09.728968 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-VolumesGetTestJSON-1802773411-project Aug 05 10:26:09.728968 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:26:09.728968 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:26:09.728968 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: 3478f4fce4034422b8313310a834b364 Aug 05 10:26:09.728968 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-VolumesGetTestJSON-1802773411-project Aug 05 10:26:09.728968 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: Aug 05 10:26:09.728968 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Volume d508740b-32c4-4771-8f3c-acd9ec0b545a could not be found. Aug 05 10:26:09.728968 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'id': 'd508740b-32c4-4771-8f3c-acd9ec0b545a'} Aug 05 10:26:09.728968 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:26:09.729581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:26:09.729581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 10:26:09.729581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 10:26:09.729581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 10:26:09.729581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 10:26:09.729581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 10:26:09.729581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 10:26:09.729581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 10:26:09.729581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 10:26:09.729581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 10:26:09.729581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 10:26:09.729581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 10:26:09.729581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 10:26:09.729581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 10:26:09.729581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 10:26:09.729581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d508740b-32c4-4771-8f3c-acd9ec0b545a could not be found. (HTTP 404) (Request-ID: req-520da155-6e07-41b4-8158-0341f0ba3170) Aug 05 10:26:09.729581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:26:09.729581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:26:09.729581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:26:09.730509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:26:09.730509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 10:26:09.730509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 10:26:09.730509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 10:26:09.730509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 10:26:09.730509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 10:26:09.730509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 10:26:09.730509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 10:26:09.730509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 10:26:09.730509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 10:26:09.730509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 10:26:09.730509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 10:26:09.730509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 10:26:09.730509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 10:26:09.730509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 10:26:09.730509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 10:26:09.730509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 10:26:09.730509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 10:26:09.730509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 10:26:09.731402 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 10:26:09.731402 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 10:26:09.731402 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 10:26:09.731402 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 10:26:09.731402 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d508740b-32c4-4771-8f3c-acd9ec0b545a could not be found. Aug 05 10:26:09.731402 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:26:09.731402 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:26:09.731402 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:26:09.731402 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:26:09.731402 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:26:09.731402 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:26:09.731402 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:26:09.731402 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:26:09.731402 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 10:26:09.731402 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 10:26:09.731402 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:26:09.731402 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:26:09.731402 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 10:26:09.731402 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:26:09.732225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d508740b-32c4-4771-8f3c-acd9ec0b545a could not be found. Aug 05 10:26:09.732225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:26:09.732225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:26:09.732225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:26:09.732225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:26:09.732225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:26:09.732225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:26:09.732225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:26:09.732225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:26:09.732225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d508740b-32c4-4771-8f3c-acd9ec0b545a could not be found. Aug 05 10:26:09.732225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:26:09.738769 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d7f79f4b-236e-499b-b230-1bec0cb4caaf tempest-VolumesGetTestJSON-1802773411 tempest-VolumesGetTestJSON-1802773411-project] Returning 404 to user: Volume d508740b-32c4-4771-8f3c-acd9ec0b545a could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:26:09.741238 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d7f79f4b-236e-499b-b230-1bec0cb4caaf tempest-VolumesGetTestJSON-1802773411 tempest-VolumesGetTestJSON-1802773411-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d508740b-32c4-4771-8f3c-acd9ec0b545a" status: 404 len: 109 microversion: 2.1 time: 0.098185 Aug 05 10:26:09.745683 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 3/7] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 10:26:09 2022] GET /compute/v2.1/os-volumes/d508740b-32c4-4771-8f3c-acd9ec0b545a => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 10:26:09.983851 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-173b087d-fd33-4330-93a3-07329fcde2b7 tempest-VolumesTestJSON-1330368677 tempest-VolumesTestJSON-1330368677-project] Calling method '.version_select at 0x7f732d445d30>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:10.047904 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-173b087d-fd33-4330-93a3-07329fcde2b7 tempest-VolumesTestJSON-1330368677 tempest-VolumesTestJSON-1330368677-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/5fe9e4ea-9f5f-40b7-8e81-a998e6432d5d" status: 200 len: 351 microversion: 2.1 time: 0.068761 Aug 05 10:26:10.048677 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 5/8] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 10:26:09 2022] GET /compute/v2.1/os-volumes/5fe9e4ea-9f5f-40b7-8e81-a998e6432d5d => generated 351 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:26:11.730532 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f44e7bd6-dca0-4b51-9504-d55475ba6983 tempest-VolumesTestJSON-1330368677 tempest-VolumesTestJSON-1330368677-project] Calling method '.version_select at 0x7f732ddd5280>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:11.818397 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f44e7bd6-dca0-4b51-9504-d55475ba6983 tempest-VolumesTestJSON-1330368677 tempest-VolumesTestJSON-1330368677-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/cf067d18-3bad-419b-b43a-0641ad0b386a" status: 200 len: 351 microversion: 2.1 time: 0.093098 Aug 05 10:26:11.833214 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 4/9] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 10:26:11 2022] GET /compute/v2.1/os-volumes/cf067d18-3bad-419b-b43a-0641ad0b386a => generated 351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:26:11.834379 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fbf3ed63-d841-4fc4-8720-c291e6954899 tempest-VolumesTestJSON-1330368677 tempest-VolumesTestJSON-1330368677-project] Calling method '.version_select at 0x7f732d464b80>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:12.009008 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fbf3ed63-d841-4fc4-8720-c291e6954899 tempest-VolumesTestJSON-1330368677 tempest-VolumesTestJSON-1330368677-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.179463 Aug 05 10:26:12.009757 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 6/10] 10.222.0.40 () {58 vars in 1134 bytes} [Fri Aug 5 10:26:11 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:26:12.025190 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-87620c91-6a71-48e1-8fca-086626eb7377 tempest-VolumesTestJSON-1330368677 tempest-VolumesTestJSON-1330368677-project] Calling method '.version_select at 0x7f732d416550>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:12.161107 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-87620c91-6a71-48e1-8fca-086626eb7377 tempest-VolumesTestJSON-1330368677 tempest-VolumesTestJSON-1330368677-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.140563 Aug 05 10:26:12.179670 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 5/11] 10.222.0.40 () {58 vars in 1149 bytes} [Fri Aug 5 10:26:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:26:12.180196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ad432d87-54e8-4530-8c48-d0e54e35606f tempest-VolumesTestJSON-1330368677 tempest-VolumesTestJSON-1330368677-project] Calling method '.version_select at 0x7f732d46b550>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:12.336617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ad432d87-54e8-4530-8c48-d0e54e35606f tempest-VolumesTestJSON-1330368677 tempest-VolumesTestJSON-1330368677-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.160543 Aug 05 10:26:12.337524 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 7/12] 10.222.0.40 () {58 vars in 1134 bytes} [Fri Aug 5 10:26:12 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:26:12.351442 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-17e5279e-5152-450c-9d9e-8d9b1e161970 tempest-VolumesTestJSON-1330368677 tempest-VolumesTestJSON-1330368677-project] Calling method '.version_select at 0x7f732d4169d0>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:12.504900 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-17e5279e-5152-450c-9d9e-8d9b1e161970 tempest-VolumesTestJSON-1330368677 tempest-VolumesTestJSON-1330368677-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.157379 Aug 05 10:26:12.505479 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 6/13] 10.222.0.40 () {58 vars in 1167 bytes} [Fri Aug 5 10:26:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:26:12.526675 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1cc81da8-73a9-4067-ba2b-7e5d393c758f tempest-VolumesTestJSON-1330368677 tempest-VolumesTestJSON-1330368677-project] Calling method '.version_select at 0x7f732d46ba60>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:12.773969 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1cc81da8-73a9-4067-ba2b-7e5d393c758f tempest-VolumesTestJSON-1330368677 tempest-VolumesTestJSON-1330368677-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.255253 Aug 05 10:26:12.784096 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 8/14] 10.222.0.40 () {58 vars in 1170 bytes} [Fri Aug 5 10:26:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:26:12.789977 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-522f5269-a9fa-41ec-b592-bd7e52f9c7e7 tempest-VolumesTestJSON-1330368677 tempest-VolumesTestJSON-1330368677-project] Calling method '.version_select at 0x7f732d43f040>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:13.005157 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-522f5269-a9fa-41ec-b592-bd7e52f9c7e7 tempest-VolumesTestJSON-1330368677 tempest-VolumesTestJSON-1330368677-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.220724 Aug 05 10:26:13.006283 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 7/15] 10.222.0.40 () {58 vars in 1155 bytes} [Fri Aug 5 10:26:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:13.019269 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-1ff6b0cc-80a3-4d9d-884e-8a24b83458f7 tempest-VolumesTestJSON-1330368677 tempest-VolumesTestJSON-1330368677-project] Calling method '.version_select at 0x7f732d443280>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:13.251181 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-1ff6b0cc-80a3-4d9d-884e-8a24b83458f7 tempest-VolumesTestJSON-1330368677 tempest-VolumesTestJSON-1330368677-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.227044 Aug 05 10:26:13.251181 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 8/16] 10.222.0.40 () {58 vars in 1188 bytes} [Fri Aug 5 10:26:13 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:26:13.272151 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-a74b68c5-d9e1-4bf0-bf9c-0e176ca5ac4c tempest-VolumesTestJSON-1330368677 tempest-VolumesTestJSON-1330368677-project] Calling method '.version_select at 0x7f732ddd5040>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:13.484447 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-a74b68c5-d9e1-4bf0-bf9c-0e176ca5ac4c tempest-VolumesTestJSON-1330368677 tempest-VolumesTestJSON-1330368677-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.225445 Aug 05 10:26:13.485099 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 9/17] 10.222.0.40 () {58 vars in 1155 bytes} [Fri Aug 5 10:26:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:13.700955 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-69062e87-1ab0-4542-af0c-39ad375ebc30 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Action: 'create', calling method: .version_select at 0x7f732d4643a0>, body: {"keypair": {"name": "tempest-keypair-175890537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMg0/XUxZ7pts3QFbOAZJIBnhi4OodGLGVsj6NPzpQhpaaKH+z0Y6fNxemq5wDvQr6fTf35ldbp6dysDXvjgc++bPkU3RuhWMamgWf9IHrgr+90RG7m2wjuYgygHSNN0eQ=="}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:26:13.828629 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-69062e87-1ab0-4542-af0c-39ad375ebc30 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Getting quotas for project 588c79a0604e49f49123980f0e9af63a. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:26:13.850876 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-69062e87-1ab0-4542-af0c-39ad375ebc30 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Getting quotas for user 706dbfa719c04fd0a3704ebd7eb812cd and project 588c79a0604e49f49123980f0e9af63a. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:26:13.993706 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-69062e87-1ab0-4542-af0c-39ad375ebc30 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.018417 Aug 05 10:26:13.995458 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 9/18] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 5 10:26:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:26:19.891200 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-cf1c1dce-c964-4915-a95e-9fce79d12772 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1129833748", "imageRef": "6163bb7c-dfd7-4fb1-a3cb-9f4818243f78", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:26:20.083313 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5373ff4f-76c1-4cf0-a545-762c1ed89c00 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-830060767", "imageRef": "6163bb7c-dfd7-4fb1-a3cb-9f4818243f78", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "35d63aef-17c7-4ac5-9809-c80ac951c47d"}], "security_groups": [{"name": "tempest-securitygroup--1025702489"}], "key_name": "tempest-keypair-175890537", "user_data": "}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:26:20.110615 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.network.neutron [None req-cf1c1dce-c964-4915-a95e-9fce79d12772 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] validate_networks() for [('0ebe6c2c-594f-404c-8238-583b3492b7a1', None, None, None, None, None)] {{(pid=117831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 10:26:20.695582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-5373ff4f-76c1-4cf0-a545-762c1ed89c00 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] validate_networks() for [('35d63aef-17c7-4ac5-9809-c80ac951c47d', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 10:26:23.113764 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-cf1c1dce-c964-4915-a95e-9fce79d12772 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Flavor limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 10:26:23.115080 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-cf1c1dce-c964-4915-a95e-9fce79d12772 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Image limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 10:26:23.115767 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-cf1c1dce-c964-4915-a95e-9fce79d12772 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Flavor pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 10:26:23.116397 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-cf1c1dce-c964-4915-a95e-9fce79d12772 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Image pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 10:26:23.117201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-cf1c1dce-c964-4915-a95e-9fce79d12772 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 10:26:23.154303 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cf1c1dce-c964-4915-a95e-9fce79d12772 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:23.157431 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cf1c1dce-c964-4915-a95e-9fce79d12772 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:23.159660 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cf1c1dce-c964-4915-a95e-9fce79d12772 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:23.160588 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cf1c1dce-c964-4915-a95e-9fce79d12772 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:23.162424 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cf1c1dce-c964-4915-a95e-9fce79d12772 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:23.163809 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cf1c1dce-c964-4915-a95e-9fce79d12772 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:23.230356 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-cf1c1dce-c964-4915-a95e-9fce79d12772 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Getting quotas for project 9ea83951557a48fcaab832aea2273453. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:26:23.250401 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-cf1c1dce-c964-4915-a95e-9fce79d12772 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Getting quotas for user a3b4d90bcfc34d2d9ba1c40316e09858 and project 9ea83951557a48fcaab832aea2273453. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:26:23.294646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-cf1c1dce-c964-4915-a95e-9fce79d12772 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Going to run 1 instances... {{(pid=117831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 10:26:23.304437 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-cf1c1dce-c964-4915-a95e-9fce79d12772 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6163bb7c-dfd7-4fb1-a3cb-9f4818243f78',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 10:26:23.510947 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-cf1c1dce-c964-4915-a95e-9fce79d12772 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.952000 Aug 05 10:26:23.518187 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 10/19] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 10:26:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 3958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 10:26:23.527768 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-03d673ad-2ade-4a6d-a0e6-95c2d779ebc3 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:23.528528 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-03d673ad-2ade-4a6d-a0e6-95c2d779ebc3 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:23.859794 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-03d673ad-2ade-4a6d-a0e6-95c2d779ebc3 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:23.896967 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=4 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:26:23.903005 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-03d673ad-2ade-4a6d-a0e6-95c2d779ebc3 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1222 microversion: 2.1 time: 0.382853 Aug 05 10:26:23.910524 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 11/20] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:23 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1222 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:26:24.365865 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-2363cfa6-20cf-4cca-aa73-77493467fe99 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-423446777", "imageRef": "6163bb7c-dfd7-4fb1-a3cb-9f4818243f78", "flavorRef": "452", "networks": [{"uuid": "0bc4c4a7-57b5-43a9-8877-c97e3d0bbf1a"}]}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:26:24.495298 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.network.neutron [None req-2363cfa6-20cf-4cca-aa73-77493467fe99 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] validate_networks() for [('0bc4c4a7-57b5-43a9-8877-c97e3d0bbf1a', None, None, None, None, None)] {{(pid=117831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 10:26:25.606820 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-2363cfa6-20cf-4cca-aa73-77493467fe99 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Flavor limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 10:26:25.607949 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-2363cfa6-20cf-4cca-aa73-77493467fe99 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Image limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 10:26:25.608586 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-2363cfa6-20cf-4cca-aa73-77493467fe99 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Flavor pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 10:26:25.609139 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-2363cfa6-20cf-4cca-aa73-77493467fe99 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Image pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 10:26:25.609712 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-2363cfa6-20cf-4cca-aa73-77493467fe99 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 10:26:25.636088 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2363cfa6-20cf-4cca-aa73-77493467fe99 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:25.638608 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2363cfa6-20cf-4cca-aa73-77493467fe99 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:25.640249 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2363cfa6-20cf-4cca-aa73-77493467fe99 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:25.641173 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2363cfa6-20cf-4cca-aa73-77493467fe99 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:25.643678 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2363cfa6-20cf-4cca-aa73-77493467fe99 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:25.645094 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2363cfa6-20cf-4cca-aa73-77493467fe99 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:25.714785 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-2363cfa6-20cf-4cca-aa73-77493467fe99 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Getting quotas for project 5a7a56c0fd0c43d4803634f30479187a. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:26:25.729694 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-2363cfa6-20cf-4cca-aa73-77493467fe99 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Getting quotas for user 9ace48889c484e4fb5fed0f8f80c3288 and project 5a7a56c0fd0c43d4803634f30479187a. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:26:25.756554 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-2363cfa6-20cf-4cca-aa73-77493467fe99 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Going to run 1 instances... {{(pid=117831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 10:26:25.762033 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-2363cfa6-20cf-4cca-aa73-77493467fe99 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6163bb7c-dfd7-4fb1-a3cb-9f4818243f78',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 10:26:25.881980 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-2363cfa6-20cf-4cca-aa73-77493467fe99 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.969467 Aug 05 10:26:25.888427 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 12/21] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 10:26:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 10:26:25.910313 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-6a50996b-69ee-45fe-8512-de87f45911c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-808271340", "imageRef": "6163bb7c-dfd7-4fb1-a3cb-9f4818243f78", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:26:26.084908 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.network.neutron [None req-6a50996b-69ee-45fe-8512-de87f45911c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] validate_networks() for [('0ebe6c2c-594f-404c-8238-583b3492b7a1', None, None, None, None, None)] {{(pid=117831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 10:26:27.220365 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-6a50996b-69ee-45fe-8512-de87f45911c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Flavor limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 10:26:27.221708 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-6a50996b-69ee-45fe-8512-de87f45911c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Image limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 10:26:27.222459 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-6a50996b-69ee-45fe-8512-de87f45911c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Flavor pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 10:26:27.223176 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-6a50996b-69ee-45fe-8512-de87f45911c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Image pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 10:26:27.225118 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-6a50996b-69ee-45fe-8512-de87f45911c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 10:26:27.273658 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6a50996b-69ee-45fe-8512-de87f45911c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:27.274136 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6a50996b-69ee-45fe-8512-de87f45911c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:27.274746 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6a50996b-69ee-45fe-8512-de87f45911c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:27.275644 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6a50996b-69ee-45fe-8512-de87f45911c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:27.276256 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6a50996b-69ee-45fe-8512-de87f45911c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:27.276834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6a50996b-69ee-45fe-8512-de87f45911c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:27.311023 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-6a50996b-69ee-45fe-8512-de87f45911c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Getting quotas for project 9ea83951557a48fcaab832aea2273453. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:26:27.319532 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-6a50996b-69ee-45fe-8512-de87f45911c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Getting quotas for user a3b4d90bcfc34d2d9ba1c40316e09858 and project 9ea83951557a48fcaab832aea2273453. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:26:27.348430 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-6a50996b-69ee-45fe-8512-de87f45911c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Going to run 1 instances... {{(pid=117831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 10:26:27.356204 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-6a50996b-69ee-45fe-8512-de87f45911c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6163bb7c-dfd7-4fb1-a3cb-9f4818243f78',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 10:26:27.460981 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-6a50996b-69ee-45fe-8512-de87f45911c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.571351 Aug 05 10:26:27.461923 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 13/22] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 10:26:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 1573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 10:26:27.466753 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-e0c5861d-b8bd-42c1-8237-79a7742e4869 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:27.473873 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-e0c5861d-b8bd-42c1-8237-79a7742e4869 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:27.487443 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e0c5861d-b8bd-42c1-8237-79a7742e4869 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:27.487928 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e0c5861d-b8bd-42c1-8237-79a7742e4869 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:27.498655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e0c5861d-b8bd-42c1-8237-79a7742e4869 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:27.499512 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e0c5861d-b8bd-42c1-8237-79a7742e4869 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:27.499960 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e0c5861d-b8bd-42c1-8237-79a7742e4869 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:27.500574 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e0c5861d-b8bd-42c1-8237-79a7742e4869 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:27.553041 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-5373ff4f-76c1-4cf0-a545-762c1ed89c00 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 10:26:27.554119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-5373ff4f-76c1-4cf0-a545-762c1ed89c00 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 10:26:27.554931 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-5373ff4f-76c1-4cf0-a545-762c1ed89c00 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 10:26:27.555627 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-5373ff4f-76c1-4cf0-a545-762c1ed89c00 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 10:26:27.556961 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-5373ff4f-76c1-4cf0-a545-762c1ed89c00 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 10:26:27.586280 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5373ff4f-76c1-4cf0-a545-762c1ed89c00 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:27.587277 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5373ff4f-76c1-4cf0-a545-762c1ed89c00 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:27.588587 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5373ff4f-76c1-4cf0-a545-762c1ed89c00 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:27.589600 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5373ff4f-76c1-4cf0-a545-762c1ed89c00 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:27.593916 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5373ff4f-76c1-4cf0-a545-762c1ed89c00 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:27.594634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5373ff4f-76c1-4cf0-a545-762c1ed89c00 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:27.657374 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-5373ff4f-76c1-4cf0-a545-762c1ed89c00 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Getting quotas for project 588c79a0604e49f49123980f0e9af63a. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:26:27.662594 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-5373ff4f-76c1-4cf0-a545-762c1ed89c00 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Getting quotas for user 706dbfa719c04fd0a3704ebd7eb812cd and project 588c79a0604e49f49123980f0e9af63a. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:26:27.698879 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5373ff4f-76c1-4cf0-a545-762c1ed89c00 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 10:26:27.702339 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5373ff4f-76c1-4cf0-a545-762c1ed89c00 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6163bb7c-dfd7-4fb1-a3cb-9f4818243f78',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 10:26:27.869152 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5373ff4f-76c1-4cf0-a545-762c1ed89c00 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 7.795302 Aug 05 10:26:27.870192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 10/23] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 10:26:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 7797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 10:26:27.885735 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-959e032c-4c31-4418-9f52-5ef5c2a68fbc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:27.892155 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-959e032c-4c31-4418-9f52-5ef5c2a68fbc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:28.037380 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e0c5861d-b8bd-42c1-8237-79a7742e4869 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:28.061730 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-e0c5861d-b8bd-42c1-8237-79a7742e4869 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1218 microversion: 2.1 time: 0.598539 Aug 05 10:26:28.083259 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 14/24] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:27 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1218 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:28.097365 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-6465ff5b-c295-4b2f-9205-71e92db5c0b3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:28.105132 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-6465ff5b-c295-4b2f-9205-71e92db5c0b3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:28.338332 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-959e032c-4c31-4418-9f52-5ef5c2a68fbc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:28.374732 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-959e032c-4c31-4418-9f52-5ef5c2a68fbc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1221 microversion: 2.1 time: 0.502929 Aug 05 10:26:28.375666 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 11/25] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:27 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1221 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:28.726702 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-6465ff5b-c295-4b2f-9205-71e92db5c0b3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:28.741137 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-6465ff5b-c295-4b2f-9205-71e92db5c0b3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1240 microversion: 2.1 time: 0.655641 Aug 05 10:26:28.742088 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 15/26] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:28 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1240 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:29.091232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c96817c7-c10e-4e8c-88bc-72033ac7fa42 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:29.092591 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c96817c7-c10e-4e8c-88bc-72033ac7fa42 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:29.112795 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c96817c7-c10e-4e8c-88bc-72033ac7fa42 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:29.116879 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c96817c7-c10e-4e8c-88bc-72033ac7fa42 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:29.117575 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c96817c7-c10e-4e8c-88bc-72033ac7fa42 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:29.122813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c96817c7-c10e-4e8c-88bc-72033ac7fa42 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:29.124531 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c96817c7-c10e-4e8c-88bc-72033ac7fa42 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:29.127120 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c96817c7-c10e-4e8c-88bc-72033ac7fa42 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:29.425714 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c96817c7-c10e-4e8c-88bc-72033ac7fa42 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:29.481153 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c96817c7-c10e-4e8c-88bc-72033ac7fa42 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1272 microversion: 2.1 time: 0.393128 Aug 05 10:26:29.486005 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 12/27] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:29 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1272 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:29.499228 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-424fb235-b84e-479b-a9da-439c6ee83a07 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:29.502475 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-424fb235-b84e-479b-a9da-439c6ee83a07 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:29.524702 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-424fb235-b84e-479b-a9da-439c6ee83a07 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:29.528266 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-424fb235-b84e-479b-a9da-439c6ee83a07 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:29.528942 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-424fb235-b84e-479b-a9da-439c6ee83a07 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:29.532555 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-424fb235-b84e-479b-a9da-439c6ee83a07 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:29.534202 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-424fb235-b84e-479b-a9da-439c6ee83a07 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:29.536028 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-424fb235-b84e-479b-a9da-439c6ee83a07 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:29.860363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-424fb235-b84e-479b-a9da-439c6ee83a07 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:29.886106 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-424fb235-b84e-479b-a9da-439c6ee83a07 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1273 microversion: 2.1 time: 0.397205 Aug 05 10:26:29.886983 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 13/28] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:29 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1273 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:29.926032 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a0be0771-24ea-4182-90bc-b68615effdf1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:29.928710 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a0be0771-24ea-4182-90bc-b68615effdf1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:29.956344 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a0be0771-24ea-4182-90bc-b68615effdf1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:29.957134 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b110c8c4-f286-42e0-a184-28a1808b9631 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Action: 'create', calling method: .version_select at 0x7f732c26c5e0>, body: {"keypair": {"name": "tempest-keypair-338874364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXf/Qx5pqOPUaXW+pf2Avaltes8KfKq4xzcH4rvdjkatFTjQm8/nVE4rz4mUeFUqKH1lz9/3IABhwYppkKpP4aa1gwxZNLoFTAoWgXH8p8box1dYqKHZVlUgAqCijqrgQ=="}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:26:29.958309 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a0be0771-24ea-4182-90bc-b68615effdf1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:29.959184 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a0be0771-24ea-4182-90bc-b68615effdf1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:29.964057 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a0be0771-24ea-4182-90bc-b68615effdf1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:29.965314 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a0be0771-24ea-4182-90bc-b68615effdf1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:29.965728 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a0be0771-24ea-4182-90bc-b68615effdf1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:30.026696 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-b110c8c4-f286-42e0-a184-28a1808b9631 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Getting quotas for project 40807f4af05048deae68cf3515433261. Resources: {'key_pairs'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:26:30.040805 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-b110c8c4-f286-42e0-a184-28a1808b9631 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Getting quotas for user 7e7eb355fac04252a4be1f8e60037924 and project 40807f4af05048deae68cf3515433261. Resources: {'key_pairs'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:26:30.121357 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b110c8c4-f286-42e0-a184-28a1808b9631 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.820243 Aug 05 10:26:30.122126 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 16/29] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 5 10:26:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:26:30.189823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a0be0771-24ea-4182-90bc-b68615effdf1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:30.211348 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a0be0771-24ea-4182-90bc-b68615effdf1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1236 microversion: 2.1 time: 0.303420 Aug 05 10:26:30.212541 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 14/30] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:29 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1236 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:30.503245 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b12b1e7b-b392-4a00-8f35-8691e35f8ca2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:30.504025 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b12b1e7b-b392-4a00-8f35-8691e35f8ca2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:30.533839 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b12b1e7b-b392-4a00-8f35-8691e35f8ca2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:30.543080 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b12b1e7b-b392-4a00-8f35-8691e35f8ca2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:30.543542 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b12b1e7b-b392-4a00-8f35-8691e35f8ca2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:30.544550 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b12b1e7b-b392-4a00-8f35-8691e35f8ca2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:30.545024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b12b1e7b-b392-4a00-8f35-8691e35f8ca2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:30.545454 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b12b1e7b-b392-4a00-8f35-8691e35f8ca2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:30.913007 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a245218f-6d57-444a-b744-bfa3389562b5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:30.914267 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a245218f-6d57-444a-b744-bfa3389562b5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:30.931440 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a245218f-6d57-444a-b744-bfa3389562b5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:30.933578 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a245218f-6d57-444a-b744-bfa3389562b5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:30.935106 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a245218f-6d57-444a-b744-bfa3389562b5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:30.943093 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a245218f-6d57-444a-b744-bfa3389562b5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:30.944924 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a245218f-6d57-444a-b744-bfa3389562b5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:30.946516 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b12b1e7b-b392-4a00-8f35-8691e35f8ca2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:30.948810 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a245218f-6d57-444a-b744-bfa3389562b5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:30.955745 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b12b1e7b-b392-4a00-8f35-8691e35f8ca2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1272 microversion: 2.1 time: 0.456734 Aug 05 10:26:30.961447 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 17/31] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:30 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1272 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:31.235948 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-6eec4e47-1cb3-4a65-8773-695ed69a08d3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:31.236572 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-6eec4e47-1cb3-4a65-8773-695ed69a08d3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:31.253038 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6eec4e47-1cb3-4a65-8773-695ed69a08d3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:31.253541 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6eec4e47-1cb3-4a65-8773-695ed69a08d3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:31.253978 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6eec4e47-1cb3-4a65-8773-695ed69a08d3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:31.254694 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6eec4e47-1cb3-4a65-8773-695ed69a08d3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:31.255178 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6eec4e47-1cb3-4a65-8773-695ed69a08d3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:31.255913 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6eec4e47-1cb3-4a65-8773-695ed69a08d3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:31.277694 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a245218f-6d57-444a-b744-bfa3389562b5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:31.290780 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a245218f-6d57-444a-b744-bfa3389562b5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1273 microversion: 2.1 time: 0.382914 Aug 05 10:26:31.297477 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 15/32] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:30 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1273 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:31.543952 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-6eec4e47-1cb3-4a65-8773-695ed69a08d3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:31.571072 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-6eec4e47-1cb3-4a65-8773-695ed69a08d3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1236 microversion: 2.1 time: 0.337768 Aug 05 10:26:31.577328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 18/33] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:31 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1236 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:26:31.992023 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8a73a51d-2215-4c03-b991-fe6db8ac1e45 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:31.993314 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8a73a51d-2215-4c03-b991-fe6db8ac1e45 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:32.018783 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a73a51d-2215-4c03-b991-fe6db8ac1e45 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:32.020225 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a73a51d-2215-4c03-b991-fe6db8ac1e45 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:32.020842 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a73a51d-2215-4c03-b991-fe6db8ac1e45 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:32.023011 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a73a51d-2215-4c03-b991-fe6db8ac1e45 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:32.024266 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a73a51d-2215-4c03-b991-fe6db8ac1e45 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:32.026249 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a73a51d-2215-4c03-b991-fe6db8ac1e45 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:32.224128 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8a73a51d-2215-4c03-b991-fe6db8ac1e45 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:32.234244 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8a73a51d-2215-4c03-b991-fe6db8ac1e45 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1272 microversion: 2.1 time: 0.252220 Aug 05 10:26:32.244807 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 16/34] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:31 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1272 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:32.322499 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-7138c3f9-89f0-43f1-9c43-867007195029 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:32.324324 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-7138c3f9-89f0-43f1-9c43-867007195029 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:32.333711 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7138c3f9-89f0-43f1-9c43-867007195029 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:32.338555 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7138c3f9-89f0-43f1-9c43-867007195029 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:32.339621 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7138c3f9-89f0-43f1-9c43-867007195029 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:32.357943 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7138c3f9-89f0-43f1-9c43-867007195029 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:32.359477 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7138c3f9-89f0-43f1-9c43-867007195029 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:32.365844 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7138c3f9-89f0-43f1-9c43-867007195029 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:32.602006 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-7138c3f9-89f0-43f1-9c43-867007195029 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:32.604510 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-eace880c-1d55-4481-bac0-dbe0b018a438 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:32.610698 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-eace880c-1d55-4481-bac0-dbe0b018a438 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:32.623046 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-7138c3f9-89f0-43f1-9c43-867007195029 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1273 microversion: 2.1 time: 0.300728 Aug 05 10:26:32.624257 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 19/35] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:32 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1273 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:32.637617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eace880c-1d55-4481-bac0-dbe0b018a438 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:32.638516 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eace880c-1d55-4481-bac0-dbe0b018a438 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:32.641345 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eace880c-1d55-4481-bac0-dbe0b018a438 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:32.642488 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eace880c-1d55-4481-bac0-dbe0b018a438 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:32.646218 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eace880c-1d55-4481-bac0-dbe0b018a438 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:32.646875 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eace880c-1d55-4481-bac0-dbe0b018a438 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:32.913949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-eace880c-1d55-4481-bac0-dbe0b018a438 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:32.929033 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-eace880c-1d55-4481-bac0-dbe0b018a438 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1236 microversion: 2.1 time: 0.331752 Aug 05 10:26:32.933415 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 17/36] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:32 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1236 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:33.257290 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d2417328-e024-4e44-8907-c9d3fbca7535 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:33.257923 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d2417328-e024-4e44-8907-c9d3fbca7535 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:33.267993 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2417328-e024-4e44-8907-c9d3fbca7535 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:33.270396 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2417328-e024-4e44-8907-c9d3fbca7535 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:33.270836 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2417328-e024-4e44-8907-c9d3fbca7535 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:33.271592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2417328-e024-4e44-8907-c9d3fbca7535 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:33.272046 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2417328-e024-4e44-8907-c9d3fbca7535 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:33.272468 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2417328-e024-4e44-8907-c9d3fbca7535 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:33.475592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d2417328-e024-4e44-8907-c9d3fbca7535 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:33.491894 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d2417328-e024-4e44-8907-c9d3fbca7535 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1272 microversion: 2.1 time: 0.238311 Aug 05 10:26:33.494508 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 18/37] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:33 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1272 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:26:33.648987 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2a9084a7-a8a6-45cc-b6b7-7bb534b1d8e5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:33.649653 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2a9084a7-a8a6-45cc-b6b7-7bb534b1d8e5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:33.662625 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2a9084a7-a8a6-45cc-b6b7-7bb534b1d8e5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:33.666173 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2a9084a7-a8a6-45cc-b6b7-7bb534b1d8e5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:33.668172 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2a9084a7-a8a6-45cc-b6b7-7bb534b1d8e5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:33.670020 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2a9084a7-a8a6-45cc-b6b7-7bb534b1d8e5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:33.672645 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2a9084a7-a8a6-45cc-b6b7-7bb534b1d8e5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:33.674027 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2a9084a7-a8a6-45cc-b6b7-7bb534b1d8e5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:33.822769 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2a9084a7-a8a6-45cc-b6b7-7bb534b1d8e5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:33.846209 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2a9084a7-a8a6-45cc-b6b7-7bb534b1d8e5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1273 microversion: 2.1 time: 0.202115 Aug 05 10:26:33.847727 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 19/38] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:33 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1273 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:33.936521 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c41ec858-f079-4ff9-8e90-0178d5cbdc71 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Action: 'create', calling method: .version_select at 0x7f732c1fb790>, body: {"keypair": {"name": "tempest-keypair-925510339", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD++mqrxrGF0BO7yGZzx32va4J3f2+Wm1XqME9HO1qsj0q2+Egj6r8ywuYr0WTvICORk0IbU+93cePiEddFxxma7MUfyChLNN7SCuvVnfFK3o1wOh443C9a8TOLwTJKa1A=="}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:26:33.959121 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d8cc46b0-7e36-435f-ba12-e3d972e6f1db tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:33.961066 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d8cc46b0-7e36-435f-ba12-e3d972e6f1db tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:33.968444 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:26:33.971666 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d8cc46b0-7e36-435f-ba12-e3d972e6f1db tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:33.972662 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d8cc46b0-7e36-435f-ba12-e3d972e6f1db tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:33.973508 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d8cc46b0-7e36-435f-ba12-e3d972e6f1db tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:33.973792 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-c41ec858-f079-4ff9-8e90-0178d5cbdc71 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Getting quotas for project 36a1fa6b4a754e47afb99e9b237ea400. Resources: {'key_pairs'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:26:33.976620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d8cc46b0-7e36-435f-ba12-e3d972e6f1db tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:33.977503 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d8cc46b0-7e36-435f-ba12-e3d972e6f1db tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:33.980917 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-c41ec858-f079-4ff9-8e90-0178d5cbdc71 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Getting quotas for user 97f671de92d240ae85ca4893d1ff04e5 and project 36a1fa6b4a754e47afb99e9b237ea400. Resources: {'key_pairs'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:26:33.986072 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d8cc46b0-7e36-435f-ba12-e3d972e6f1db tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:34.027685 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c41ec858-f079-4ff9-8e90-0178d5cbdc71 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.826980 Aug 05 10:26:34.029105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 20/39] 10.222.0.40 () {62 vars in 1200 bytes} [Fri Aug 5 10:26:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 831 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 05 10:26:34.114502 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d8cc46b0-7e36-435f-ba12-e3d972e6f1db tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:34.125201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d8cc46b0-7e36-435f-ba12-e3d972e6f1db tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1236 microversion: 2.1 time: 0.172957 Aug 05 10:26:34.127982 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 20/40] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:33 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1236 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:26:34.514885 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c4474169-682a-47fb-b13e-e257e3dd6595 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:34.515741 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c4474169-682a-47fb-b13e-e257e3dd6595 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:34.528840 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c4474169-682a-47fb-b13e-e257e3dd6595 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:34.528840 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c4474169-682a-47fb-b13e-e257e3dd6595 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:34.530234 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c4474169-682a-47fb-b13e-e257e3dd6595 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:34.531029 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c4474169-682a-47fb-b13e-e257e3dd6595 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:34.537761 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c4474169-682a-47fb-b13e-e257e3dd6595 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:34.538555 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c4474169-682a-47fb-b13e-e257e3dd6595 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:34.687697 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4290edfe-ed0d-4ffe-b952-6b1a040aa401 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1447199894", "imageRef": "6163bb7c-dfd7-4fb1-a3cb-9f4818243f78", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ead70490-96c2-4cbf-9f92-222a27e84943"}], "security_groups": [{"name": "tempest-securitygroup--514495031"}], "key_name": "tempest-keypair-338874364", "user_data": "}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:26:34.702822 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c4474169-682a-47fb-b13e-e257e3dd6595 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:34.716525 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c4474169-682a-47fb-b13e-e257e3dd6595 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1272 microversion: 2.1 time: 0.205097 Aug 05 10:26:34.730572 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 21/41] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:34 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1272 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:34.870173 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-3fea6c13-7744-40ad-b859-b398b7b00fe0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:34.873830 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-3fea6c13-7744-40ad-b859-b398b7b00fe0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:34.890749 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3fea6c13-7744-40ad-b859-b398b7b00fe0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:34.896271 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3fea6c13-7744-40ad-b859-b398b7b00fe0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:34.896735 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3fea6c13-7744-40ad-b859-b398b7b00fe0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:34.897691 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3fea6c13-7744-40ad-b859-b398b7b00fe0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:34.898233 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3fea6c13-7744-40ad-b859-b398b7b00fe0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:34.898859 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3fea6c13-7744-40ad-b859-b398b7b00fe0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:35.020034 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-4290edfe-ed0d-4ffe-b952-6b1a040aa401 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] validate_networks() for [('ead70490-96c2-4cbf-9f92-222a27e84943', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 10:26:35.254753 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-3fea6c13-7744-40ad-b859-b398b7b00fe0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:35.271243 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-3fea6c13-7744-40ad-b859-b398b7b00fe0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1273 microversion: 2.1 time: 0.398986 Aug 05 10:26:35.272212 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 22/42] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:34 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1273 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:26:35.287220 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-9e733d0e-bf13-4d16-9d4a-4b3e243a5158 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:35.288088 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-9e733d0e-bf13-4d16-9d4a-4b3e243a5158 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:35.299945 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9e733d0e-bf13-4d16-9d4a-4b3e243a5158 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:35.300723 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9e733d0e-bf13-4d16-9d4a-4b3e243a5158 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:35.304006 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9e733d0e-bf13-4d16-9d4a-4b3e243a5158 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:35.305196 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9e733d0e-bf13-4d16-9d4a-4b3e243a5158 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:35.307079 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9e733d0e-bf13-4d16-9d4a-4b3e243a5158 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:35.321968 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9e733d0e-bf13-4d16-9d4a-4b3e243a5158 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:36.015726 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-9e733d0e-bf13-4d16-9d4a-4b3e243a5158 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:36.018160 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-4290edfe-ed0d-4ffe-b952-6b1a040aa401 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 10:26:36.018653 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-4290edfe-ed0d-4ffe-b952-6b1a040aa401 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 10:26:36.019174 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-4290edfe-ed0d-4ffe-b952-6b1a040aa401 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 10:26:36.019779 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-4290edfe-ed0d-4ffe-b952-6b1a040aa401 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 10:26:36.020395 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-4290edfe-ed0d-4ffe-b952-6b1a040aa401 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 10:26:36.036271 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-9e733d0e-bf13-4d16-9d4a-4b3e243a5158 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1236 microversion: 2.1 time: 0.762763 Aug 05 10:26:36.038757 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4290edfe-ed0d-4ffe-b952-6b1a040aa401 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:36.039505 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4290edfe-ed0d-4ffe-b952-6b1a040aa401 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:36.040265 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 23/43] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:35 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1236 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:36.040911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4290edfe-ed0d-4ffe-b952-6b1a040aa401 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:36.042572 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4290edfe-ed0d-4ffe-b952-6b1a040aa401 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:36.057824 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4290edfe-ed0d-4ffe-b952-6b1a040aa401 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:36.058539 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4290edfe-ed0d-4ffe-b952-6b1a040aa401 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:36.071766 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-dfa824c7-e09c-4c8a-add3-7e36a6647386 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:36.076563 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-dfa824c7-e09c-4c8a-add3-7e36a6647386 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:36.096876 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dfa824c7-e09c-4c8a-add3-7e36a6647386 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:36.111524 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-4290edfe-ed0d-4ffe-b952-6b1a040aa401 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Getting quotas for project 40807f4af05048deae68cf3515433261. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:26:36.113287 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dfa824c7-e09c-4c8a-add3-7e36a6647386 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:36.114329 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dfa824c7-e09c-4c8a-add3-7e36a6647386 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:36.119778 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dfa824c7-e09c-4c8a-add3-7e36a6647386 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:36.125213 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dfa824c7-e09c-4c8a-add3-7e36a6647386 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:36.125372 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-4290edfe-ed0d-4ffe-b952-6b1a040aa401 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Getting quotas for user 7e7eb355fac04252a4be1f8e60037924 and project 40807f4af05048deae68cf3515433261. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:26:36.129040 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dfa824c7-e09c-4c8a-add3-7e36a6647386 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:36.166500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4290edfe-ed0d-4ffe-b952-6b1a040aa401 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 10:26:36.176458 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4290edfe-ed0d-4ffe-b952-6b1a040aa401 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6163bb7c-dfd7-4fb1-a3cb-9f4818243f78',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 10:26:36.396406 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4290edfe-ed0d-4ffe-b952-6b1a040aa401 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.712788 Aug 05 10:26:36.400363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 21/44] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 10:26:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 1718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 10:26:36.415274 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1983018a-ebcc-477d-bc0c-149a2662831c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:36.418276 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1983018a-ebcc-477d-bc0c-149a2662831c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:36.464801 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1983018a-ebcc-477d-bc0c-149a2662831c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:36.465364 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1983018a-ebcc-477d-bc0c-149a2662831c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:36.465815 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1983018a-ebcc-477d-bc0c-149a2662831c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:36.473829 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1983018a-ebcc-477d-bc0c-149a2662831c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:36.476741 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1983018a-ebcc-477d-bc0c-149a2662831c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:36.478212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1983018a-ebcc-477d-bc0c-149a2662831c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:36.508536 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-dfa824c7-e09c-4c8a-add3-7e36a6647386 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:36.527047 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-dfa824c7-e09c-4c8a-add3-7e36a6647386 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1272 microversion: 2.1 time: 0.480891 Aug 05 10:26:36.529243 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 24/45] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:36 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1272 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:36.535850 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-8b6594bd-3ebb-47d1-98cc-d02fa8f398dd tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:36.537129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-8b6594bd-3ebb-47d1-98cc-d02fa8f398dd tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:36.586620 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:26:36.623411 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1983018a-ebcc-477d-bc0c-149a2662831c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:36.642479 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1983018a-ebcc-477d-bc0c-149a2662831c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1291 microversion: 2.1 time: 0.239840 Aug 05 10:26:36.644746 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 22/46] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:36 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1291 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:37.067739 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4fdca292-ffab-45fd-943b-b5ec18e44b9e tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:37.068410 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4fdca292-ffab-45fd-943b-b5ec18e44b9e tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:37.081365 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4fdca292-ffab-45fd-943b-b5ec18e44b9e tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:37.083925 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4fdca292-ffab-45fd-943b-b5ec18e44b9e tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:37.084434 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4fdca292-ffab-45fd-943b-b5ec18e44b9e tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:37.085380 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4fdca292-ffab-45fd-943b-b5ec18e44b9e tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:37.086218 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4fdca292-ffab-45fd-943b-b5ec18e44b9e tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:37.090672 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4fdca292-ffab-45fd-943b-b5ec18e44b9e tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:37.302547 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=6 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:26:37.344501 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4fdca292-ffab-45fd-943b-b5ec18e44b9e tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:37.353779 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4fdca292-ffab-45fd-943b-b5ec18e44b9e tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1300 microversion: 2.1 time: 0.293333 Aug 05 10:26:37.357527 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 23/47] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:37 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1300 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:37.550181 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-633d6e58-2845-49da-ad50-4ae800918a79 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:37.551301 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-633d6e58-2845-49da-ad50-4ae800918a79 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:37.567423 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-633d6e58-2845-49da-ad50-4ae800918a79 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:37.571936 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-633d6e58-2845-49da-ad50-4ae800918a79 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:37.572653 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-633d6e58-2845-49da-ad50-4ae800918a79 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:37.573619 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-633d6e58-2845-49da-ad50-4ae800918a79 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:37.580750 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-633d6e58-2845-49da-ad50-4ae800918a79 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:37.581462 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-633d6e58-2845-49da-ad50-4ae800918a79 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:38.176990 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-633d6e58-2845-49da-ad50-4ae800918a79 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:38.185460 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-633d6e58-2845-49da-ad50-4ae800918a79 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1272 microversion: 2.1 time: 0.640642 Aug 05 10:26:38.192827 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 24/48] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:37 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1272 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:26:38.200026 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5f7b7fe4-1a21-4212-9ed4-612e46571cfc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:38.205067 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5f7b7fe4-1a21-4212-9ed4-612e46571cfc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:38.226147 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe4-1a21-4212-9ed4-612e46571cfc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:38.233316 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe4-1a21-4212-9ed4-612e46571cfc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:38.233946 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe4-1a21-4212-9ed4-612e46571cfc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:38.235788 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe4-1a21-4212-9ed4-612e46571cfc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:38.239561 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe4-1a21-4212-9ed4-612e46571cfc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:38.243008 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5f7b7fe4-1a21-4212-9ed4-612e46571cfc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:38.640027 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5f7b7fe4-1a21-4212-9ed4-612e46571cfc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:38.656631 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5f7b7fe4-1a21-4212-9ed4-612e46571cfc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1279 microversion: 2.1 time: 0.462218 Aug 05 10:26:38.668927 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 25/49] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:38 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1279 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:38.688811 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2763c9a3-e20d-494d-8b16-5cf35ed9a2f9 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:38.695606 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2763c9a3-e20d-494d-8b16-5cf35ed9a2f9 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:38.696189 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-8b6594bd-3ebb-47d1-98cc-d02fa8f398dd tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:38.707370 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-8b6594bd-3ebb-47d1-98cc-d02fa8f398dd tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1237 microversion: 2.1 time: 2.174552 Aug 05 10:26:38.708991 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2763c9a3-e20d-494d-8b16-5cf35ed9a2f9 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:38.710663 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 25/50] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:36 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1237 bytes in 2181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:38.729277 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2763c9a3-e20d-494d-8b16-5cf35ed9a2f9 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:38.732124 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2763c9a3-e20d-494d-8b16-5cf35ed9a2f9 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:38.733042 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2763c9a3-e20d-494d-8b16-5cf35ed9a2f9 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:38.735702 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2763c9a3-e20d-494d-8b16-5cf35ed9a2f9 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:38.736293 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2763c9a3-e20d-494d-8b16-5cf35ed9a2f9 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:39.208217 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-fb84e40f-adea-4052-a003-e3d5bb6f22b2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:39.216935 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-fb84e40f-adea-4052-a003-e3d5bb6f22b2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:39.241955 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2763c9a3-e20d-494d-8b16-5cf35ed9a2f9 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:39.250175 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fb84e40f-adea-4052-a003-e3d5bb6f22b2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:39.250756 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fb84e40f-adea-4052-a003-e3d5bb6f22b2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:39.251499 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fb84e40f-adea-4052-a003-e3d5bb6f22b2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:39.252363 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fb84e40f-adea-4052-a003-e3d5bb6f22b2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:39.255676 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fb84e40f-adea-4052-a003-e3d5bb6f22b2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:39.256126 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fb84e40f-adea-4052-a003-e3d5bb6f22b2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:39.260863 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2763c9a3-e20d-494d-8b16-5cf35ed9a2f9 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1298 microversion: 2.1 time: 0.582669 Aug 05 10:26:39.266822 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 26/51] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:38 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1298 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:39.693881 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d61a1d41-7c6c-40de-9742-47f043e15466 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:39.696053 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d61a1d41-7c6c-40de-9742-47f043e15466 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:39.715558 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d61a1d41-7c6c-40de-9742-47f043e15466 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:39.716289 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d61a1d41-7c6c-40de-9742-47f043e15466 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:39.717498 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d61a1d41-7c6c-40de-9742-47f043e15466 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:39.719962 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d61a1d41-7c6c-40de-9742-47f043e15466 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:39.721631 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d61a1d41-7c6c-40de-9742-47f043e15466 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:39.723472 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d61a1d41-7c6c-40de-9742-47f043e15466 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:40.203574 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d61a1d41-7c6c-40de-9742-47f043e15466 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:40.211179 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d61a1d41-7c6c-40de-9742-47f043e15466 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1279 microversion: 2.1 time: 0.525434 Aug 05 10:26:40.211806 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 27/52] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:39 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1279 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:26:40.266708 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-039fa313-db1c-41f4-b57c-3e35ad1b13e0 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:40.267460 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-039fa313-db1c-41f4-b57c-3e35ad1b13e0 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:40.293054 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-039fa313-db1c-41f4-b57c-3e35ad1b13e0 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:40.293535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-039fa313-db1c-41f4-b57c-3e35ad1b13e0 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:40.305360 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-039fa313-db1c-41f4-b57c-3e35ad1b13e0 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:40.307663 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-039fa313-db1c-41f4-b57c-3e35ad1b13e0 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:40.315646 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-039fa313-db1c-41f4-b57c-3e35ad1b13e0 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:40.316152 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-039fa313-db1c-41f4-b57c-3e35ad1b13e0 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:40.445150 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-fb84e40f-adea-4052-a003-e3d5bb6f22b2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:40.464401 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-fb84e40f-adea-4052-a003-e3d5bb6f22b2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 1.257238 Aug 05 10:26:40.485731 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 26/53] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:39 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:40.504108 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-e9bc3e4d-7a11-41f1-9473-acb5cbd383d6 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:40.513385 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-e9bc3e4d-7a11-41f1-9473-acb5cbd383d6 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:40.542889 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e9bc3e4d-7a11-41f1-9473-acb5cbd383d6 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:40.546874 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e9bc3e4d-7a11-41f1-9473-acb5cbd383d6 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:40.549061 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e9bc3e4d-7a11-41f1-9473-acb5cbd383d6 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:40.552175 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e9bc3e4d-7a11-41f1-9473-acb5cbd383d6 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:40.555436 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e9bc3e4d-7a11-41f1-9473-acb5cbd383d6 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:40.559150 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e9bc3e4d-7a11-41f1-9473-acb5cbd383d6 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:40.839713 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-039fa313-db1c-41f4-b57c-3e35ad1b13e0 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:40.843460 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:26:40.857629 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-039fa313-db1c-41f4-b57c-3e35ad1b13e0 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1295 microversion: 2.1 time: 0.627991 Aug 05 10:26:40.859581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 28/54] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:40 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1295 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:41.232675 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6612b6bf-eefd-497e-bbe0-b93249295c91 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:41.233617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6612b6bf-eefd-497e-bbe0-b93249295c91 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:41.251287 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6612b6bf-eefd-497e-bbe0-b93249295c91 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:41.254064 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6612b6bf-eefd-497e-bbe0-b93249295c91 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:41.258860 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6612b6bf-eefd-497e-bbe0-b93249295c91 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:41.264005 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6612b6bf-eefd-497e-bbe0-b93249295c91 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:41.265687 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6612b6bf-eefd-497e-bbe0-b93249295c91 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:41.267645 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6612b6bf-eefd-497e-bbe0-b93249295c91 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:41.549325 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e9bc3e4d-7a11-41f1-9473-acb5cbd383d6 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:41.561509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-e9bc3e4d-7a11-41f1-9473-acb5cbd383d6 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1298 microversion: 2.1 time: 1.073415 Aug 05 10:26:41.562998 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 27/55] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:40 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1298 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:41.570060 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-297025e0-b86c-40ec-85bb-e1a6dc2b028e tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:41.571196 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-297025e0-b86c-40ec-85bb-e1a6dc2b028e tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:41.583765 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-297025e0-b86c-40ec-85bb-e1a6dc2b028e tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:41.584473 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-297025e0-b86c-40ec-85bb-e1a6dc2b028e tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:41.590251 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-297025e0-b86c-40ec-85bb-e1a6dc2b028e tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:41.592462 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-297025e0-b86c-40ec-85bb-e1a6dc2b028e tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:41.593219 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-297025e0-b86c-40ec-85bb-e1a6dc2b028e tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:41.598243 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-297025e0-b86c-40ec-85bb-e1a6dc2b028e tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:41.608947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6612b6bf-eefd-497e-bbe0-b93249295c91 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:41.618514 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6612b6bf-eefd-497e-bbe0-b93249295c91 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1279 microversion: 2.1 time: 0.390423 Aug 05 10:26:41.630209 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 29/56] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:41 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1279 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:26:41.882667 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0a2cae67-2e3a-48c3-9ea5-40bf87f51d01 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:41.883459 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0a2cae67-2e3a-48c3-9ea5-40bf87f51d01 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:41.899003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a2cae67-2e3a-48c3-9ea5-40bf87f51d01 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:41.899899 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a2cae67-2e3a-48c3-9ea5-40bf87f51d01 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:41.902543 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a2cae67-2e3a-48c3-9ea5-40bf87f51d01 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:41.909283 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a2cae67-2e3a-48c3-9ea5-40bf87f51d01 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:41.909820 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a2cae67-2e3a-48c3-9ea5-40bf87f51d01 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:41.910195 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a2cae67-2e3a-48c3-9ea5-40bf87f51d01 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:42.079489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0a2cae67-2e3a-48c3-9ea5-40bf87f51d01 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:42.091535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0a2cae67-2e3a-48c3-9ea5-40bf87f51d01 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1295 microversion: 2.1 time: 0.210390 Aug 05 10:26:42.093454 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 30/57] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:41 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1295 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:42.476239 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e8092a45-9471-4e7c-919e-7bbb332e5d82 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1361739650", "imageRef": "6163bb7c-dfd7-4fb1-a3cb-9f4818243f78", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0e109e3-8d82-41e1-9f13-a0b45cc03a92"}], "security_groups": [{"name": "tempest-securitygroup--1886246664"}], "key_name": "tempest-keypair-925510339", "user_data": "}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:26:42.856091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-297025e0-b86c-40ec-85bb-e1a6dc2b028e tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:42.881538 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-297025e0-b86c-40ec-85bb-e1a6dc2b028e tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 1.315582 Aug 05 10:26:42.884231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 28/58] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:41 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:42.908579 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-5b8bd2e7-2341-416f-a8f5-c26cd233cd82 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:42.909909 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-5b8bd2e7-2341-416f-a8f5-c26cd233cd82 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:42.930776 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5b8bd2e7-2341-416f-a8f5-c26cd233cd82 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:42.932874 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5b8bd2e7-2341-416f-a8f5-c26cd233cd82 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:42.933396 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5b8bd2e7-2341-416f-a8f5-c26cd233cd82 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:42.934210 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5b8bd2e7-2341-416f-a8f5-c26cd233cd82 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:42.936815 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5b8bd2e7-2341-416f-a8f5-c26cd233cd82 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:42.937336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5b8bd2e7-2341-416f-a8f5-c26cd233cd82 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:43.339015 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-5b8bd2e7-2341-416f-a8f5-c26cd233cd82 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:43.364334 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-5b8bd2e7-2341-416f-a8f5-c26cd233cd82 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1298 microversion: 2.1 time: 0.474493 Aug 05 10:26:43.365249 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 29/59] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:42 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1298 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:43.393128 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-15ec2677-611e-4622-87bf-4680c9e5b79e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:43.399724 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-15ec2677-611e-4622-87bf-4680c9e5b79e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:43.418276 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-15ec2677-611e-4622-87bf-4680c9e5b79e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:43.418867 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-15ec2677-611e-4622-87bf-4680c9e5b79e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:43.419246 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-15ec2677-611e-4622-87bf-4680c9e5b79e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:43.419977 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-15ec2677-611e-4622-87bf-4680c9e5b79e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:43.420430 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-15ec2677-611e-4622-87bf-4680c9e5b79e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:43.420858 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-15ec2677-611e-4622-87bf-4680c9e5b79e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:43.718790 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-e8092a45-9471-4e7c-919e-7bbb332e5d82 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] validate_networks() for [('a0e109e3-8d82-41e1-9f13-a0b45cc03a92', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 10:26:44.407263 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-15ec2677-611e-4622-87bf-4680c9e5b79e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:44.419293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-15ec2677-611e-4622-87bf-4680c9e5b79e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 1.044412 Aug 05 10:26:44.454519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 30/60] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:43 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:44.690127 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-37de2e59-cc41-4fa5-9812-882641dbe221 req-02cd8e14-db35-4f68-aa8a-e0864380ed36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ffbb1e1-7319-4e06-8218-45198955c4fc", "tag": "879cd29f-43ad-44a3-9710-970b15b11ed9"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:26:44.778745 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-37de2e59-cc41-4fa5-9812-882641dbe221 req-02cd8e14-db35-4f68-aa8a-e0864380ed36 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:44.782543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-37de2e59-cc41-4fa5-9812-882641dbe221 req-02cd8e14-db35-4f68-aa8a-e0864380ed36 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:44.783421 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-37de2e59-cc41-4fa5-9812-882641dbe221 req-02cd8e14-db35-4f68-aa8a-e0864380ed36 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:44.879408 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-37de2e59-cc41-4fa5-9812-882641dbe221 req-02cd8e14-db35-4f68-aa8a-e0864380ed36 service nova] Creating event network-changed:879cd29f-43ad-44a3-9710-970b15b11ed9 for instance 5ffbb1e1-7319-4e06-8218-45198955c4fc on hv-cinder-81558 Aug 05 10:26:44.880353 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-37de2e59-cc41-4fa5-9812-882641dbe221 req-02cd8e14-db35-4f68-aa8a-e0864380ed36 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 05 10:26:44.894387 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-37de2e59-cc41-4fa5-9812-882641dbe221 req-02cd8e14-db35-4f68-aa8a-e0864380ed36 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 05 10:26:44.895904 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-21d6f9ca-cb7e-4e1d-93ab-0735d8be1402 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:44.900187 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-21d6f9ca-cb7e-4e1d-93ab-0735d8be1402 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:44.908442 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-21d6f9ca-cb7e-4e1d-93ab-0735d8be1402 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:44.911800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-21d6f9ca-cb7e-4e1d-93ab-0735d8be1402 None None] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:44.914270 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-21d6f9ca-cb7e-4e1d-93ab-0735d8be1402 None None] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:44.916276 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-21d6f9ca-cb7e-4e1d-93ab-0735d8be1402 None None] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:44.958880 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.compute.rpcapi [None req-21d6f9ca-cb7e-4e1d-93ab-0735d8be1402 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 05 10:26:44.962547 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-21d6f9ca-cb7e-4e1d-93ab-0735d8be1402 None None] Releasing lock "compute-rpcapi-router" {{(pid=117831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 05 10:26:45.021615 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-21d6f9ca-cb7e-4e1d-93ab-0735d8be1402 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.565428 Aug 05 10:26:45.022860 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 31/61] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:26:45.029572 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-e9ff81a4-699e-4fff-80d6-4491ce1f04bc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:45.030194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-e9ff81a4-699e-4fff-80d6-4491ce1f04bc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:45.059093 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e9ff81a4-699e-4fff-80d6-4491ce1f04bc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:45.059611 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e9ff81a4-699e-4fff-80d6-4491ce1f04bc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:45.076343 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e9ff81a4-699e-4fff-80d6-4491ce1f04bc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:45.078399 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e9ff81a4-699e-4fff-80d6-4491ce1f04bc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:45.079027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e9ff81a4-699e-4fff-80d6-4491ce1f04bc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:45.079578 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e9ff81a4-699e-4fff-80d6-4491ce1f04bc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:46.087425 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=4 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:26:46.144374 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=14 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:26:46.246522 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-e8092a45-9471-4e7c-919e-7bbb332e5d82 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 10:26:46.247163 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-e8092a45-9471-4e7c-919e-7bbb332e5d82 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 10:26:46.247916 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-e8092a45-9471-4e7c-919e-7bbb332e5d82 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 10:26:46.248566 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-e8092a45-9471-4e7c-919e-7bbb332e5d82 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 10:26:46.249104 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-e8092a45-9471-4e7c-919e-7bbb332e5d82 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 10:26:46.281836 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8092a45-9471-4e7c-919e-7bbb332e5d82 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:46.290103 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8092a45-9471-4e7c-919e-7bbb332e5d82 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:46.290697 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8092a45-9471-4e7c-919e-7bbb332e5d82 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:46.291674 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8092a45-9471-4e7c-919e-7bbb332e5d82 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:46.293490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8092a45-9471-4e7c-919e-7bbb332e5d82 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:46.294318 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8092a45-9471-4e7c-919e-7bbb332e5d82 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:46.353758 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e9ff81a4-699e-4fff-80d6-4491ce1f04bc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:46.363056 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-e9ff81a4-699e-4fff-80d6-4491ce1f04bc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 1.338864 Aug 05 10:26:46.363663 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 32/62] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:45 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:46.382221 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-e8092a45-9471-4e7c-919e-7bbb332e5d82 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Getting quotas for project 36a1fa6b4a754e47afb99e9b237ea400. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:26:46.390565 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-29a42477-7acd-400a-a9fc-414c50e8ef97 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:46.393344 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-29a42477-7acd-400a-a9fc-414c50e8ef97 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:46.394774 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-e8092a45-9471-4e7c-919e-7bbb332e5d82 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Getting quotas for user 97f671de92d240ae85ca4893d1ff04e5 and project 36a1fa6b4a754e47afb99e9b237ea400. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:26:46.406785 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-29a42477-7acd-400a-a9fc-414c50e8ef97 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:46.410402 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-29a42477-7acd-400a-a9fc-414c50e8ef97 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:46.411066 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-29a42477-7acd-400a-a9fc-414c50e8ef97 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:46.413145 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-29a42477-7acd-400a-a9fc-414c50e8ef97 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:46.416786 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-29a42477-7acd-400a-a9fc-414c50e8ef97 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:46.417435 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-29a42477-7acd-400a-a9fc-414c50e8ef97 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:46.429714 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e8092a45-9471-4e7c-919e-7bbb332e5d82 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 10:26:46.436192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e8092a45-9471-4e7c-919e-7bbb332e5d82 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6163bb7c-dfd7-4fb1-a3cb-9f4818243f78',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 10:26:46.586754 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e8092a45-9471-4e7c-919e-7bbb332e5d82 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.110290 Aug 05 10:26:46.587547 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 31/63] 10.222.0.40 () {62 vars in 1188 bytes} [Fri Aug 5 10:26:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 4117 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 05 10:26:46.616293 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-697b3e26-cfbc-4b89-b1ec-109f72fcecc8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:46.619872 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-697b3e26-cfbc-4b89-b1ec-109f72fcecc8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:46.636395 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-697b3e26-cfbc-4b89-b1ec-109f72fcecc8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:46.639624 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-697b3e26-cfbc-4b89-b1ec-109f72fcecc8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:46.640751 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-697b3e26-cfbc-4b89-b1ec-109f72fcecc8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:46.642172 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-697b3e26-cfbc-4b89-b1ec-109f72fcecc8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:46.643585 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-697b3e26-cfbc-4b89-b1ec-109f72fcecc8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:46.655716 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-697b3e26-cfbc-4b89-b1ec-109f72fcecc8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:47.064833 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-29a42477-7acd-400a-a9fc-414c50e8ef97 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:47.071645 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=100 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:26:47.079203 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-29a42477-7acd-400a-a9fc-414c50e8ef97 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.697891 Aug 05 10:26:47.081327 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 33/64] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:46 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:47.239337 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-697b3e26-cfbc-4b89-b1ec-109f72fcecc8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:47.247155 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-697b3e26-cfbc-4b89-b1ec-109f72fcecc8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.656119 Aug 05 10:26:47.252891 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 32/65] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:46 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:47.270821 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f45239e4-fcc6-4ca0-85c9-7bf6a4df9c5d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:47.273090 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f45239e4-fcc6-4ca0-85c9-7bf6a4df9c5d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:47.285281 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f45239e4-fcc6-4ca0-85c9-7bf6a4df9c5d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:47.286044 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f45239e4-fcc6-4ca0-85c9-7bf6a4df9c5d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:47.287474 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f45239e4-fcc6-4ca0-85c9-7bf6a4df9c5d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:47.288725 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f45239e4-fcc6-4ca0-85c9-7bf6a4df9c5d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:47.289423 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f45239e4-fcc6-4ca0-85c9-7bf6a4df9c5d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:47.290616 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f45239e4-fcc6-4ca0-85c9-7bf6a4df9c5d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:47.296957 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-3f2a9f4c-414c-49f6-a31b-e02341e767f9 req-ecb98412-a381-4982-881e-964772a64138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7ae11ba-1225-48ce-b816-2e84d1778111", "tag": "b0d6ae53-174d-4155-9329-092d0984bc0d"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:26:47.308729 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-3f2a9f4c-414c-49f6-a31b-e02341e767f9 req-ecb98412-a381-4982-881e-964772a64138 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:47.309423 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-3f2a9f4c-414c-49f6-a31b-e02341e767f9 req-ecb98412-a381-4982-881e-964772a64138 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:47.310192 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-3f2a9f4c-414c-49f6-a31b-e02341e767f9 req-ecb98412-a381-4982-881e-964772a64138 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:47.323898 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-3f2a9f4c-414c-49f6-a31b-e02341e767f9 req-ecb98412-a381-4982-881e-964772a64138 service nova] Creating event network-changed:b0d6ae53-174d-4155-9329-092d0984bc0d for instance a7ae11ba-1225-48ce-b816-2e84d1778111 on hv-cinder-81558 Aug 05 10:26:47.329642 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-3f2a9f4c-414c-49f6-a31b-e02341e767f9 req-ecb98412-a381-4982-881e-964772a64138 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245239 Aug 05 10:26:47.330471 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 34/66] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:26:47.336706 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ce0e47bc-2c86-4ab1-a1d5-66e342537331 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:47.337602 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-ce0e47bc-2c86-4ab1-a1d5-66e342537331 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:47.492148 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f45239e4-fcc6-4ca0-85c9-7bf6a4df9c5d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:47.504243 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f45239e4-fcc6-4ca0-85c9-7bf6a4df9c5d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.250134 Aug 05 10:26:47.506550 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 33/67] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:47 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:47.511688 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-c31da00e-66b6-4dfb-afe0-7cdd70908237 req-43928721-6b04-48cf-9470-c4c3ab82a6ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfcbf025-92b9-4b98-8819-7f9fb41dce79", "tag": "d4746dc0-741a-473e-b9a5-dd97a9ff2872"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:26:47.533744 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c31da00e-66b6-4dfb-afe0-7cdd70908237 req-43928721-6b04-48cf-9470-c4c3ab82a6ac service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:47.534406 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c31da00e-66b6-4dfb-afe0-7cdd70908237 req-43928721-6b04-48cf-9470-c4c3ab82a6ac service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:47.534844 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c31da00e-66b6-4dfb-afe0-7cdd70908237 req-43928721-6b04-48cf-9470-c4c3ab82a6ac service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:47.552419 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ce0e47bc-2c86-4ab1-a1d5-66e342537331 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:47.558395 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-c31da00e-66b6-4dfb-afe0-7cdd70908237 req-43928721-6b04-48cf-9470-c4c3ab82a6ac service nova] Creating event network-changed:d4746dc0-741a-473e-b9a5-dd97a9ff2872 for instance cfcbf025-92b9-4b98-8819-7f9fb41dce79 on hv-cinder-81558 Aug 05 10:26:47.559313 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c31da00e-66b6-4dfb-afe0-7cdd70908237 req-43928721-6b04-48cf-9470-c4c3ab82a6ac service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 05 10:26:47.559847 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c31da00e-66b6-4dfb-afe0-7cdd70908237 req-43928721-6b04-48cf-9470-c4c3ab82a6ac service nova] Acquired lock "compute-rpcapi-router" {{(pid=117832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 05 10:26:47.561182 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d45753f-6001-436d-b554-64ab3bf30435 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:47.561680 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d45753f-6001-436d-b554-64ab3bf30435 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:47.562245 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d45753f-6001-436d-b554-64ab3bf30435 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:47.562807 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d45753f-6001-436d-b554-64ab3bf30435 None None] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:47.563592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d45753f-6001-436d-b554-64ab3bf30435 None None] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:47.564009 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d45753f-6001-436d-b554-64ab3bf30435 None None] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:47.568163 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ce0e47bc-2c86-4ab1-a1d5-66e342537331 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:47.573187 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ce0e47bc-2c86-4ab1-a1d5-66e342537331 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:47.575271 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.compute.rpcapi [None req-7d45753f-6001-436d-b554-64ab3bf30435 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 05 10:26:47.576181 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d45753f-6001-436d-b554-64ab3bf30435 None None] Releasing lock "compute-rpcapi-router" {{(pid=117832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 05 10:26:47.579270 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ce0e47bc-2c86-4ab1-a1d5-66e342537331 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1281 microversion: 2.20 time: 0.247180 Aug 05 10:26:47.584817 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:26:47 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1281 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:26:47.601349 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-9b18b35c-a312-49fd-a1bf-fc2c1103ccb5 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:47.604117 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-9b18b35c-a312-49fd-a1bf-fc2c1103ccb5 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:47.615960 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7d45753f-6001-436d-b554-64ab3bf30435 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099580 Aug 05 10:26:47.616660 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 34/69] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:26:47.622660 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9b18b35c-a312-49fd-a1bf-fc2c1103ccb5 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:47.623541 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9b18b35c-a312-49fd-a1bf-fc2c1103ccb5 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:47.623665 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9b18b35c-a312-49fd-a1bf-fc2c1103ccb5 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:47.624277 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9b18b35c-a312-49fd-a1bf-fc2c1103ccb5 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:47.624721 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9b18b35c-a312-49fd-a1bf-fc2c1103ccb5 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:47.625135 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9b18b35c-a312-49fd-a1bf-fc2c1103ccb5 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:47.919736 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-9b18b35c-a312-49fd-a1bf-fc2c1103ccb5 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:47.928162 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-9b18b35c-a312-49fd-a1bf-fc2c1103ccb5 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.342032 Aug 05 10:26:47.928965 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 36/70] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:47 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:48.102250 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f9232ccf-0754-46d1-ad19-3c5a0eb2fe7d tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:48.102967 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f9232ccf-0754-46d1-ad19-3c5a0eb2fe7d tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:48.109297 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f9232ccf-0754-46d1-ad19-3c5a0eb2fe7d tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:48.109779 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f9232ccf-0754-46d1-ad19-3c5a0eb2fe7d tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:48.110693 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f9232ccf-0754-46d1-ad19-3c5a0eb2fe7d tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:48.111530 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f9232ccf-0754-46d1-ad19-3c5a0eb2fe7d tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:48.112149 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f9232ccf-0754-46d1-ad19-3c5a0eb2fe7d tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:48.112753 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f9232ccf-0754-46d1-ad19-3c5a0eb2fe7d tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:48.268747 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-5f6eda6b-61a8-4bcf-a1b4-12d4ebc5643e tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:48.269354 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-5f6eda6b-61a8-4bcf-a1b4-12d4ebc5643e tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:48.280076 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5f6eda6b-61a8-4bcf-a1b4-12d4ebc5643e tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:48.280562 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5f6eda6b-61a8-4bcf-a1b4-12d4ebc5643e tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:48.280991 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5f6eda6b-61a8-4bcf-a1b4-12d4ebc5643e tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:48.281683 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5f6eda6b-61a8-4bcf-a1b4-12d4ebc5643e tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:48.285320 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5f6eda6b-61a8-4bcf-a1b4-12d4ebc5643e tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:48.285743 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5f6eda6b-61a8-4bcf-a1b4-12d4ebc5643e tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:48.300186 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f9232ccf-0754-46d1-ad19-3c5a0eb2fe7d tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:48.310809 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f9232ccf-0754-46d1-ad19-3c5a0eb2fe7d tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.212496 Aug 05 10:26:48.312106 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 35/71] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:48 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:48.479964 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-5f6eda6b-61a8-4bcf-a1b4-12d4ebc5643e tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:48.489676 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-5f6eda6b-61a8-4bcf-a1b4-12d4ebc5643e tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.224962 Aug 05 10:26:48.504244 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 37/72] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:48 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:26:48.533060 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e8c6c952-0139-4af5-9fc1-f85385c65f6e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:48.533926 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e8c6c952-0139-4af5-9fc1-f85385c65f6e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:48.550670 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8c6c952-0139-4af5-9fc1-f85385c65f6e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:48.551184 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8c6c952-0139-4af5-9fc1-f85385c65f6e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:48.551779 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8c6c952-0139-4af5-9fc1-f85385c65f6e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:48.552628 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8c6c952-0139-4af5-9fc1-f85385c65f6e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:48.553730 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8c6c952-0139-4af5-9fc1-f85385c65f6e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:48.554517 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e8c6c952-0139-4af5-9fc1-f85385c65f6e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:48.608104 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-fc72ff6e-cee8-4781-baaa-ce625a081bed tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:48.608787 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-fc72ff6e-cee8-4781-baaa-ce625a081bed tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:48.617572 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fc72ff6e-cee8-4781-baaa-ce625a081bed tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:48.618250 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fc72ff6e-cee8-4781-baaa-ce625a081bed tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:48.619094 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fc72ff6e-cee8-4781-baaa-ce625a081bed tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:48.620312 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fc72ff6e-cee8-4781-baaa-ce625a081bed tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:48.620969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fc72ff6e-cee8-4781-baaa-ce625a081bed tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:48.621554 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fc72ff6e-cee8-4781-baaa-ce625a081bed tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:48.705489 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-fc72ff6e-cee8-4781-baaa-ce625a081bed tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:48.715445 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-fc72ff6e-cee8-4781-baaa-ce625a081bed tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:48.717466 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-fc72ff6e-cee8-4781-baaa-ce625a081bed tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:48.718753 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-fc72ff6e-cee8-4781-baaa-ce625a081bed tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1285 microversion: 2.20 time: 0.114670 Aug 05 10:26:48.720587 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 38/73] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:26:48 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 10:26:48.789836 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e8c6c952-0139-4af5-9fc1-f85385c65f6e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:48.798225 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e8c6c952-0139-4af5-9fc1-f85385c65f6e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.269907 Aug 05 10:26:48.798661 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 36/74] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:48 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:48.950025 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-91e2be4a-69e6-487d-a772-ff9180eced15 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:48.950803 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-91e2be4a-69e6-487d-a772-ff9180eced15 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:48.960459 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-91e2be4a-69e6-487d-a772-ff9180eced15 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:48.960906 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-91e2be4a-69e6-487d-a772-ff9180eced15 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:48.961526 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-91e2be4a-69e6-487d-a772-ff9180eced15 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:48.962536 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-91e2be4a-69e6-487d-a772-ff9180eced15 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:48.963328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-91e2be4a-69e6-487d-a772-ff9180eced15 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:48.964619 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-91e2be4a-69e6-487d-a772-ff9180eced15 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:49.332337 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-77b083fa-d40f-4fe9-a0d2-19303be99c7b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:49.334170 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-77b083fa-d40f-4fe9-a0d2-19303be99c7b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:49.345011 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-77b083fa-d40f-4fe9-a0d2-19303be99c7b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:49.345524 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-77b083fa-d40f-4fe9-a0d2-19303be99c7b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:49.345964 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-77b083fa-d40f-4fe9-a0d2-19303be99c7b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:49.346727 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-77b083fa-d40f-4fe9-a0d2-19303be99c7b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:49.347150 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-77b083fa-d40f-4fe9-a0d2-19303be99c7b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:49.347570 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-77b083fa-d40f-4fe9-a0d2-19303be99c7b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:49.525501 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-91e2be4a-69e6-487d-a772-ff9180eced15 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:49.533527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-91e2be4a-69e6-487d-a772-ff9180eced15 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.587788 Aug 05 10:26:49.553913 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 39/75] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:48 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:26:49.564183 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-33d35f8b-7930-4f85-b5f8-14095947c8f9 req-777f0ef2-1f02-4a84-8ee1-063dd765a3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d6b3944-32c7-4652-be72-e448219cee78", "tag": "0504379a-29d1-4c32-8abd-1c246bd31d77"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:26:49.585469 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-33d35f8b-7930-4f85-b5f8-14095947c8f9 req-777f0ef2-1f02-4a84-8ee1-063dd765a3b5 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:49.585958 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-33d35f8b-7930-4f85-b5f8-14095947c8f9 req-777f0ef2-1f02-4a84-8ee1-063dd765a3b5 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:49.586337 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-33d35f8b-7930-4f85-b5f8-14095947c8f9 req-777f0ef2-1f02-4a84-8ee1-063dd765a3b5 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:49.607871 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-33d35f8b-7930-4f85-b5f8-14095947c8f9 req-777f0ef2-1f02-4a84-8ee1-063dd765a3b5 service nova] Creating event network-changed:0504379a-29d1-4c32-8abd-1c246bd31d77 for instance 3d6b3944-32c7-4652-be72-e448219cee78 on hv-cinder-81558 Aug 05 10:26:49.613081 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-33d35f8b-7930-4f85-b5f8-14095947c8f9 req-777f0ef2-1f02-4a84-8ee1-063dd765a3b5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057634 Aug 05 10:26:49.613740 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 40/76] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:26:49.618727 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b6a8324f-002d-47ec-8a0d-453e1f67954f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:49.619454 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b6a8324f-002d-47ec-8a0d-453e1f67954f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:49.635163 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b6a8324f-002d-47ec-8a0d-453e1f67954f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:49.635684 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b6a8324f-002d-47ec-8a0d-453e1f67954f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:49.637167 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b6a8324f-002d-47ec-8a0d-453e1f67954f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:49.637901 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b6a8324f-002d-47ec-8a0d-453e1f67954f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:49.638362 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b6a8324f-002d-47ec-8a0d-453e1f67954f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:49.638798 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b6a8324f-002d-47ec-8a0d-453e1f67954f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:49.703169 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-77b083fa-d40f-4fe9-a0d2-19303be99c7b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:49.713269 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-77b083fa-d40f-4fe9-a0d2-19303be99c7b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.385145 Aug 05 10:26:49.714303 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 37/77] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:49 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:49.747430 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8c77701b-2508-49a5-a078-52a545336cd9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:49.748047 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8c77701b-2508-49a5-a078-52a545336cd9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:49.756847 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8c77701b-2508-49a5-a078-52a545336cd9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:49.757339 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8c77701b-2508-49a5-a078-52a545336cd9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:49.757773 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8c77701b-2508-49a5-a078-52a545336cd9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:49.758506 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8c77701b-2508-49a5-a078-52a545336cd9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:49.759229 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8c77701b-2508-49a5-a078-52a545336cd9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:49.759658 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8c77701b-2508-49a5-a078-52a545336cd9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:49.844664 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8c77701b-2508-49a5-a078-52a545336cd9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:49.854140 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8c77701b-2508-49a5-a078-52a545336cd9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:49.855699 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8c77701b-2508-49a5-a078-52a545336cd9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:49.856873 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8c77701b-2508-49a5-a078-52a545336cd9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1333 microversion: 2.20 time: 0.114992 Aug 05 10:26:49.871339 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 38/78] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:26:49 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1333 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 10:26:49.880000 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c91f27d6-4bd9-43c6-b690-adefe40bc610 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:49.880894 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c91f27d6-4bd9-43c6-b690-adefe40bc610 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:49.887921 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c91f27d6-4bd9-43c6-b690-adefe40bc610 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:49.888645 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c91f27d6-4bd9-43c6-b690-adefe40bc610 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:49.889953 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c91f27d6-4bd9-43c6-b690-adefe40bc610 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:49.890881 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c91f27d6-4bd9-43c6-b690-adefe40bc610 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:49.891831 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c91f27d6-4bd9-43c6-b690-adefe40bc610 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:49.892455 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c91f27d6-4bd9-43c6-b690-adefe40bc610 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:50.056971 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c91f27d6-4bd9-43c6-b690-adefe40bc610 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:50.065686 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c91f27d6-4bd9-43c6-b690-adefe40bc610 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.192875 Aug 05 10:26:50.066713 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 39/79] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:49 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:50.254473 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b6a8324f-002d-47ec-8a0d-453e1f67954f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:50.264732 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b6a8324f-002d-47ec-8a0d-453e1f67954f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.649650 Aug 05 10:26:50.278729 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 41/80] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:49 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:50.557723 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6823e5ae-e7e1-432d-b10b-a8d2d65956f3 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:50.558503 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6823e5ae-e7e1-432d-b10b-a8d2d65956f3 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:50.566018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6823e5ae-e7e1-432d-b10b-a8d2d65956f3 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:50.566796 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6823e5ae-e7e1-432d-b10b-a8d2d65956f3 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:50.567498 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6823e5ae-e7e1-432d-b10b-a8d2d65956f3 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:50.568502 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6823e5ae-e7e1-432d-b10b-a8d2d65956f3 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:50.569662 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6823e5ae-e7e1-432d-b10b-a8d2d65956f3 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:50.570427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6823e5ae-e7e1-432d-b10b-a8d2d65956f3 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:50.711878 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6823e5ae-e7e1-432d-b10b-a8d2d65956f3 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:50.719538 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6823e5ae-e7e1-432d-b10b-a8d2d65956f3 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.166426 Aug 05 10:26:50.720210 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 40/81] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:50 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:50.738206 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-0fb27380-f898-4c4e-adb4-c37e88f33083 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:50.738817 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-0fb27380-f898-4c4e-adb4-c37e88f33083 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:50.745233 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0fb27380-f898-4c4e-adb4-c37e88f33083 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:50.745715 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0fb27380-f898-4c4e-adb4-c37e88f33083 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:50.746248 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0fb27380-f898-4c4e-adb4-c37e88f33083 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:50.747044 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0fb27380-f898-4c4e-adb4-c37e88f33083 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:50.747507 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0fb27380-f898-4c4e-adb4-c37e88f33083 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:50.747931 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0fb27380-f898-4c4e-adb4-c37e88f33083 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:50.879597 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-0fb27380-f898-4c4e-adb4-c37e88f33083 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:50.885975 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d1b4c5d6-c3c3-4159-9481-31c93a7561fc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:50.886926 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d1b4c5d6-c3c3-4159-9481-31c93a7561fc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:50.900632 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-0fb27380-f898-4c4e-adb4-c37e88f33083 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.166357 Aug 05 10:26:50.901158 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d1b4c5d6-c3c3-4159-9481-31c93a7561fc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:50.901676 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d1b4c5d6-c3c3-4159-9481-31c93a7561fc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:50.902135 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d1b4c5d6-c3c3-4159-9481-31c93a7561fc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:50.902803 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d1b4c5d6-c3c3-4159-9481-31c93a7561fc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:50.903279 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d1b4c5d6-c3c3-4159-9481-31c93a7561fc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:50.903692 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d1b4c5d6-c3c3-4159-9481-31c93a7561fc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:50.909133 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 42/82] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:50 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:50.972276 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d1b4c5d6-c3c3-4159-9481-31c93a7561fc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:50.980304 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d1b4c5d6-c3c3-4159-9481-31c93a7561fc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:50.981904 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d1b4c5d6-c3c3-4159-9481-31c93a7561fc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:50.983038 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d1b4c5d6-c3c3-4159-9481-31c93a7561fc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1333 microversion: 2.20 time: 0.101077 Aug 05 10:26:50.983573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 41/83] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:26:50 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1333 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 10:26:51.088265 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-a3a2c8ee-d692-4c49-a408-1f55c38172a2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:51.089176 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-a3a2c8ee-d692-4c49-a408-1f55c38172a2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:51.097060 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a3a2c8ee-d692-4c49-a408-1f55c38172a2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:51.097544 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a3a2c8ee-d692-4c49-a408-1f55c38172a2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:51.097978 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a3a2c8ee-d692-4c49-a408-1f55c38172a2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:51.098672 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a3a2c8ee-d692-4c49-a408-1f55c38172a2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:51.099167 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a3a2c8ee-d692-4c49-a408-1f55c38172a2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:51.099591 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a3a2c8ee-d692-4c49-a408-1f55c38172a2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:51.247203 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a3a2c8ee-d692-4c49-a408-1f55c38172a2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:51.259075 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-a3a2c8ee-d692-4c49-a408-1f55c38172a2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.176495 Aug 05 10:26:51.260062 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 43/84] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:51 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:51.289148 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-253b2f8b-1083-45d7-9898-4470566458ea tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:51.289364 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-253b2f8b-1083-45d7-9898-4470566458ea tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:51.295594 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-253b2f8b-1083-45d7-9898-4470566458ea tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:51.296070 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-253b2f8b-1083-45d7-9898-4470566458ea tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:51.296552 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-253b2f8b-1083-45d7-9898-4470566458ea tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:51.297538 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-253b2f8b-1083-45d7-9898-4470566458ea tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:51.298228 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-253b2f8b-1083-45d7-9898-4470566458ea tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:51.299001 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-253b2f8b-1083-45d7-9898-4470566458ea tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:51.444679 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-253b2f8b-1083-45d7-9898-4470566458ea tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:51.452496 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-253b2f8b-1083-45d7-9898-4470566458ea tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.171503 Aug 05 10:26:51.453067 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 42/85] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:51 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:26:51.647728 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-b072d53b-fb68-44a1-b9dd-748374cd4acc req-7a6b1f3c-2e12-4da8-9048-dd418c9165f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cef9d70-01bd-4d04-829d-2495d889f34a", "tag": "7375bfe2-586c-4ea8-9eaf-e4a40b7c68d9"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:26:51.657649 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-b072d53b-fb68-44a1-b9dd-748374cd4acc req-7a6b1f3c-2e12-4da8-9048-dd418c9165f2 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:51.657939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-b072d53b-fb68-44a1-b9dd-748374cd4acc req-7a6b1f3c-2e12-4da8-9048-dd418c9165f2 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:51.658741 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-b072d53b-fb68-44a1-b9dd-748374cd4acc req-7a6b1f3c-2e12-4da8-9048-dd418c9165f2 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:51.671146 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-b072d53b-fb68-44a1-b9dd-748374cd4acc req-7a6b1f3c-2e12-4da8-9048-dd418c9165f2 service nova] Creating event network-changed:7375bfe2-586c-4ea8-9eaf-e4a40b7c68d9 for instance 6cef9d70-01bd-4d04-829d-2495d889f34a on hv-cinder-81558 Aug 05 10:26:51.676755 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-b072d53b-fb68-44a1-b9dd-748374cd4acc req-7a6b1f3c-2e12-4da8-9048-dd418c9165f2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032643 Aug 05 10:26:51.677353 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 44/86] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:26:51.740738 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a1ab20f8-77d6-455a-a578-7fc5bfdf5b97 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:51.741344 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a1ab20f8-77d6-455a-a578-7fc5bfdf5b97 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:51.748021 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a1ab20f8-77d6-455a-a578-7fc5bfdf5b97 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:51.748481 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a1ab20f8-77d6-455a-a578-7fc5bfdf5b97 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:51.749063 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a1ab20f8-77d6-455a-a578-7fc5bfdf5b97 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:51.750080 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a1ab20f8-77d6-455a-a578-7fc5bfdf5b97 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:51.750617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a1ab20f8-77d6-455a-a578-7fc5bfdf5b97 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:51.751207 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a1ab20f8-77d6-455a-a578-7fc5bfdf5b97 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:51.893674 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a1ab20f8-77d6-455a-a578-7fc5bfdf5b97 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:51.903004 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a1ab20f8-77d6-455a-a578-7fc5bfdf5b97 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.165924 Aug 05 10:26:51.914934 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 43/87] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:51 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:51.928967 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b3ef3a34-d00e-4939-a371-01803f9f6833 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:51.930296 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b3ef3a34-d00e-4939-a371-01803f9f6833 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:51.937102 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b3ef3a34-d00e-4939-a371-01803f9f6833 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:51.937575 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b3ef3a34-d00e-4939-a371-01803f9f6833 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:51.938063 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b3ef3a34-d00e-4939-a371-01803f9f6833 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:51.938957 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b3ef3a34-d00e-4939-a371-01803f9f6833 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:51.939293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b3ef3a34-d00e-4939-a371-01803f9f6833 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:51.939701 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b3ef3a34-d00e-4939-a371-01803f9f6833 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:52.006361 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c8987b3a-4999-4056-9f3a-43769c67cfa4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:52.007149 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c8987b3a-4999-4056-9f3a-43769c67cfa4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:52.013244 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c8987b3a-4999-4056-9f3a-43769c67cfa4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:52.013724 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c8987b3a-4999-4056-9f3a-43769c67cfa4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:52.014150 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c8987b3a-4999-4056-9f3a-43769c67cfa4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:52.014835 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c8987b3a-4999-4056-9f3a-43769c67cfa4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:52.015799 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c8987b3a-4999-4056-9f3a-43769c67cfa4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:52.016268 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c8987b3a-4999-4056-9f3a-43769c67cfa4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:52.072990 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b3ef3a34-d00e-4939-a371-01803f9f6833 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:52.081824 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b3ef3a34-d00e-4939-a371-01803f9f6833 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.156992 Aug 05 10:26:52.082447 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 45/88] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:51 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:52.083407 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c8987b3a-4999-4056-9f3a-43769c67cfa4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:52.091406 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c8987b3a-4999-4056-9f3a-43769c67cfa4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:52.092894 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c8987b3a-4999-4056-9f3a-43769c67cfa4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:52.093972 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c8987b3a-4999-4056-9f3a-43769c67cfa4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1333 microversion: 2.20 time: 0.091613 Aug 05 10:26:52.094744 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 44/89] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:26:52 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1333 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 10:26:52.279792 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-7a882fe9-88ce-4344-bbca-6afc6af904c5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:52.280404 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-7a882fe9-88ce-4344-bbca-6afc6af904c5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:52.287349 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7a882fe9-88ce-4344-bbca-6afc6af904c5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:52.287830 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7a882fe9-88ce-4344-bbca-6afc6af904c5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:52.288273 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7a882fe9-88ce-4344-bbca-6afc6af904c5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:52.288961 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7a882fe9-88ce-4344-bbca-6afc6af904c5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:52.289399 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7a882fe9-88ce-4344-bbca-6afc6af904c5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:52.289826 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7a882fe9-88ce-4344-bbca-6afc6af904c5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:52.422996 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-7a882fe9-88ce-4344-bbca-6afc6af904c5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:52.433578 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-7a882fe9-88ce-4344-bbca-6afc6af904c5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.157746 Aug 05 10:26:52.434482 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 46/90] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:52 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:52.475199 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6a4a1cee-6375-472d-9e6c-59a7802febd3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:52.476651 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6a4a1cee-6375-472d-9e6c-59a7802febd3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:52.484985 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a4a1cee-6375-472d-9e6c-59a7802febd3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:52.485470 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a4a1cee-6375-472d-9e6c-59a7802febd3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:52.485904 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a4a1cee-6375-472d-9e6c-59a7802febd3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:52.486691 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a4a1cee-6375-472d-9e6c-59a7802febd3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:52.487313 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a4a1cee-6375-472d-9e6c-59a7802febd3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:52.488061 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a4a1cee-6375-472d-9e6c-59a7802febd3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:52.624539 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6a4a1cee-6375-472d-9e6c-59a7802febd3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:52.633057 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6a4a1cee-6375-472d-9e6c-59a7802febd3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.162898 Aug 05 10:26:52.633840 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 45/91] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:52 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:52.925601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-574f6200-b27b-4aa7-863e-c8d79be3e54a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:52.926211 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-574f6200-b27b-4aa7-863e-c8d79be3e54a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:52.932650 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-574f6200-b27b-4aa7-863e-c8d79be3e54a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:52.933279 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-574f6200-b27b-4aa7-863e-c8d79be3e54a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:52.933589 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-574f6200-b27b-4aa7-863e-c8d79be3e54a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:52.934241 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-574f6200-b27b-4aa7-863e-c8d79be3e54a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:52.934688 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-574f6200-b27b-4aa7-863e-c8d79be3e54a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:52.935148 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-574f6200-b27b-4aa7-863e-c8d79be3e54a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:53.078434 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-574f6200-b27b-4aa7-863e-c8d79be3e54a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:53.086286 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-574f6200-b27b-4aa7-863e-c8d79be3e54a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.165244 Aug 05 10:26:53.089538 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 47/92] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:52 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:53.103534 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-83c79364-090a-4e99-ae66-1c790ed3b6ee tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:53.104140 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-83c79364-090a-4e99-ae66-1c790ed3b6ee tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:53.110280 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83c79364-090a-4e99-ae66-1c790ed3b6ee tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:53.110753 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83c79364-090a-4e99-ae66-1c790ed3b6ee tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:53.111227 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83c79364-090a-4e99-ae66-1c790ed3b6ee tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:53.112152 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83c79364-090a-4e99-ae66-1c790ed3b6ee tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:53.112598 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83c79364-090a-4e99-ae66-1c790ed3b6ee tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:53.113037 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83c79364-090a-4e99-ae66-1c790ed3b6ee tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:53.116942 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-74abde8b-1e6a-49b4-a441-ecfe3ace5ba4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:53.117737 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-74abde8b-1e6a-49b4-a441-ecfe3ace5ba4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:53.123984 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-74abde8b-1e6a-49b4-a441-ecfe3ace5ba4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:53.124461 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-74abde8b-1e6a-49b4-a441-ecfe3ace5ba4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:53.124897 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-74abde8b-1e6a-49b4-a441-ecfe3ace5ba4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:53.125777 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-74abde8b-1e6a-49b4-a441-ecfe3ace5ba4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:53.126226 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-74abde8b-1e6a-49b4-a441-ecfe3ace5ba4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:53.126708 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-74abde8b-1e6a-49b4-a441-ecfe3ace5ba4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:53.132533 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:26:53.196003 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-74abde8b-1e6a-49b4-a441-ecfe3ace5ba4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:53.205596 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-74abde8b-1e6a-49b4-a441-ecfe3ace5ba4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:53.207120 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-74abde8b-1e6a-49b4-a441-ecfe3ace5ba4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:53.208227 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-74abde8b-1e6a-49b4-a441-ecfe3ace5ba4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1341 microversion: 2.20 time: 0.095243 Aug 05 10:26:53.209098 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 48/93] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:26:53 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1341 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 10:26:53.264336 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-83c79364-090a-4e99-ae66-1c790ed3b6ee tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:53.272528 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-83c79364-090a-4e99-ae66-1c790ed3b6ee tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.173045 Aug 05 10:26:53.283761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 46/94] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:53 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:53.456217 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c06a8d90-94a0-4983-abb8-6e1233ad01dd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:53.457201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c06a8d90-94a0-4983-abb8-6e1233ad01dd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:53.464122 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c06a8d90-94a0-4983-abb8-6e1233ad01dd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:53.464734 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c06a8d90-94a0-4983-abb8-6e1233ad01dd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:53.465244 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c06a8d90-94a0-4983-abb8-6e1233ad01dd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:53.466033 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c06a8d90-94a0-4983-abb8-6e1233ad01dd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:53.466569 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c06a8d90-94a0-4983-abb8-6e1233ad01dd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:53.467294 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c06a8d90-94a0-4983-abb8-6e1233ad01dd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:53.619712 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c06a8d90-94a0-4983-abb8-6e1233ad01dd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:53.630523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c06a8d90-94a0-4983-abb8-6e1233ad01dd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.178819 Aug 05 10:26:53.643720 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 49/95] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:53 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:53.654034 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-589c9755-ecb4-42b9-8f8b-b4cb007c1bd5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:53.654765 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-589c9755-ecb4-42b9-8f8b-b4cb007c1bd5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:53.662224 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-589c9755-ecb4-42b9-8f8b-b4cb007c1bd5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:53.663036 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-589c9755-ecb4-42b9-8f8b-b4cb007c1bd5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:53.663673 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-589c9755-ecb4-42b9-8f8b-b4cb007c1bd5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:53.664810 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-589c9755-ecb4-42b9-8f8b-b4cb007c1bd5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:53.671900 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-589c9755-ecb4-42b9-8f8b-b4cb007c1bd5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:53.672389 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-589c9755-ecb4-42b9-8f8b-b4cb007c1bd5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:53.816243 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-589c9755-ecb4-42b9-8f8b-b4cb007c1bd5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:53.825877 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-589c9755-ecb4-42b9-8f8b-b4cb007c1bd5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.175682 Aug 05 10:26:53.826708 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 47/96] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:53 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:54.106237 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-e1f2430e-1339-40aa-83b0-cdf7c91cf8a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:54.107778 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-e1f2430e-1339-40aa-83b0-cdf7c91cf8a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:54.114166 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e1f2430e-1339-40aa-83b0-cdf7c91cf8a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:54.114775 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e1f2430e-1339-40aa-83b0-cdf7c91cf8a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:54.115323 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e1f2430e-1339-40aa-83b0-cdf7c91cf8a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:54.116030 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e1f2430e-1339-40aa-83b0-cdf7c91cf8a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:54.116485 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e1f2430e-1339-40aa-83b0-cdf7c91cf8a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:54.116910 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e1f2430e-1339-40aa-83b0-cdf7c91cf8a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:54.235859 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-34595b69-d1a6-4be3-bda1-4d07b142c91c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:54.243081 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-34595b69-d1a6-4be3-bda1-4d07b142c91c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:54.257125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34595b69-d1a6-4be3-bda1-4d07b142c91c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:54.258499 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34595b69-d1a6-4be3-bda1-4d07b142c91c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:54.259022 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34595b69-d1a6-4be3-bda1-4d07b142c91c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:54.259948 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34595b69-d1a6-4be3-bda1-4d07b142c91c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:54.260875 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34595b69-d1a6-4be3-bda1-4d07b142c91c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:54.261363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34595b69-d1a6-4be3-bda1-4d07b142c91c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:54.278070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e1f2430e-1339-40aa-83b0-cdf7c91cf8a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:54.285647 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-e1f2430e-1339-40aa-83b0-cdf7c91cf8a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.183282 Aug 05 10:26:54.299764 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 50/97] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:54 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:54.307138 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d3d7a087-c8fd-4bc3-803c-0d0cb8157dda tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:54.308070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d3d7a087-c8fd-4bc3-803c-0d0cb8157dda tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:54.314738 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d3d7a087-c8fd-4bc3-803c-0d0cb8157dda tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:54.315464 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d3d7a087-c8fd-4bc3-803c-0d0cb8157dda tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:54.316221 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d3d7a087-c8fd-4bc3-803c-0d0cb8157dda tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:54.317263 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d3d7a087-c8fd-4bc3-803c-0d0cb8157dda tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:54.318263 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d3d7a087-c8fd-4bc3-803c-0d0cb8157dda tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:54.318841 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d3d7a087-c8fd-4bc3-803c-0d0cb8157dda tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:54.331651 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-34595b69-d1a6-4be3-bda1-4d07b142c91c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:54.340968 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-34595b69-d1a6-4be3-bda1-4d07b142c91c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:54.345525 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-34595b69-d1a6-4be3-bda1-4d07b142c91c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:54.346103 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-34595b69-d1a6-4be3-bda1-4d07b142c91c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1341 microversion: 2.20 time: 0.116690 Aug 05 10:26:54.347121 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 48/98] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:26:54 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1341 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:26:54.511424 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d3d7a087-c8fd-4bc3-803c-0d0cb8157dda tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:54.519754 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d3d7a087-c8fd-4bc3-803c-0d0cb8157dda tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.218804 Aug 05 10:26:54.520330 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 51/99] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:54 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:54.654344 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-78f6cd1d-de95-4072-adb4-08348255ab7c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:54.655261 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-78f6cd1d-de95-4072-adb4-08348255ab7c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:54.663199 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-78f6cd1d-de95-4072-adb4-08348255ab7c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:54.663664 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-78f6cd1d-de95-4072-adb4-08348255ab7c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:54.664101 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-78f6cd1d-de95-4072-adb4-08348255ab7c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:54.665114 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-78f6cd1d-de95-4072-adb4-08348255ab7c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:54.665872 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-78f6cd1d-de95-4072-adb4-08348255ab7c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:54.666541 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-78f6cd1d-de95-4072-adb4-08348255ab7c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:54.814937 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-78f6cd1d-de95-4072-adb4-08348255ab7c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:54.823797 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-78f6cd1d-de95-4072-adb4-08348255ab7c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.174649 Aug 05 10:26:54.824365 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 49/100] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:54 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:54.847298 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-2891dc59-05e0-4c90-8905-685838158374 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:54.847899 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-2891dc59-05e0-4c90-8905-685838158374 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:54.854826 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2891dc59-05e0-4c90-8905-685838158374 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:54.855732 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2891dc59-05e0-4c90-8905-685838158374 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:54.856184 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2891dc59-05e0-4c90-8905-685838158374 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:54.857552 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2891dc59-05e0-4c90-8905-685838158374 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:54.858041 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2891dc59-05e0-4c90-8905-685838158374 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:54.858735 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2891dc59-05e0-4c90-8905-685838158374 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:54.951416 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=2 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:26:55.078075 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2891dc59-05e0-4c90-8905-685838158374 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:55.086214 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-2891dc59-05e0-4c90-8905-685838158374 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.242805 Aug 05 10:26:55.086808 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 52/101] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:54 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:55.306332 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d4dd6a89-7934-4c19-8e6c-a4472a5bbb3c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:55.307029 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d4dd6a89-7934-4c19-8e6c-a4472a5bbb3c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:55.313260 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d4dd6a89-7934-4c19-8e6c-a4472a5bbb3c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:55.313812 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d4dd6a89-7934-4c19-8e6c-a4472a5bbb3c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:55.314244 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d4dd6a89-7934-4c19-8e6c-a4472a5bbb3c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:55.315018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d4dd6a89-7934-4c19-8e6c-a4472a5bbb3c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:55.315471 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d4dd6a89-7934-4c19-8e6c-a4472a5bbb3c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:55.315893 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d4dd6a89-7934-4c19-8e6c-a4472a5bbb3c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:55.368790 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-e632e15b-e962-4c18-8895-19ba9cc4dd8b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:55.369394 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-e632e15b-e962-4c18-8895-19ba9cc4dd8b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:55.375671 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e632e15b-e962-4c18-8895-19ba9cc4dd8b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:55.376187 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e632e15b-e962-4c18-8895-19ba9cc4dd8b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:55.376612 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e632e15b-e962-4c18-8895-19ba9cc4dd8b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:55.377305 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e632e15b-e962-4c18-8895-19ba9cc4dd8b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:55.377749 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e632e15b-e962-4c18-8895-19ba9cc4dd8b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:55.378167 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e632e15b-e962-4c18-8895-19ba9cc4dd8b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:55.397045 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=100 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:26:55.447868 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e632e15b-e962-4c18-8895-19ba9cc4dd8b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:55.460150 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e632e15b-e962-4c18-8895-19ba9cc4dd8b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:55.462212 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e632e15b-e962-4c18-8895-19ba9cc4dd8b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:55.463521 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-e632e15b-e962-4c18-8895-19ba9cc4dd8b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1341 microversion: 2.20 time: 0.098660 Aug 05 10:26:55.465012 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 53/102] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:26:55 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1341 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:26:55.479961 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d4dd6a89-7934-4c19-8e6c-a4472a5bbb3c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:55.487781 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d4dd6a89-7934-4c19-8e6c-a4472a5bbb3c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.185409 Aug 05 10:26:55.488348 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 50/103] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:55 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:55.539818 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-107e1fb6-3004-4c8e-8577-4156bcd3a92f tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:55.540347 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-107e1fb6-3004-4c8e-8577-4156bcd3a92f tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:55.546339 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-107e1fb6-3004-4c8e-8577-4156bcd3a92f tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:55.546809 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-107e1fb6-3004-4c8e-8577-4156bcd3a92f tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:55.547452 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-107e1fb6-3004-4c8e-8577-4156bcd3a92f tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:55.548359 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-107e1fb6-3004-4c8e-8577-4156bcd3a92f tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:55.548804 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-107e1fb6-3004-4c8e-8577-4156bcd3a92f tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:55.549217 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-107e1fb6-3004-4c8e-8577-4156bcd3a92f tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:55.700413 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-107e1fb6-3004-4c8e-8577-4156bcd3a92f tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:55.709418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-107e1fb6-3004-4c8e-8577-4156bcd3a92f tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.173681 Aug 05 10:26:55.710144 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 54/104] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:55 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:55.844787 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-30226b6f-ee18-4a53-a318-dafaef5df6bb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:55.845418 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-30226b6f-ee18-4a53-a318-dafaef5df6bb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:55.851565 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30226b6f-ee18-4a53-a318-dafaef5df6bb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:55.852059 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30226b6f-ee18-4a53-a318-dafaef5df6bb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:55.852484 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30226b6f-ee18-4a53-a318-dafaef5df6bb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:55.853164 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30226b6f-ee18-4a53-a318-dafaef5df6bb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:55.853614 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30226b6f-ee18-4a53-a318-dafaef5df6bb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:55.854033 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30226b6f-ee18-4a53-a318-dafaef5df6bb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:55.996599 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-30226b6f-ee18-4a53-a318-dafaef5df6bb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:56.005723 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-30226b6f-ee18-4a53-a318-dafaef5df6bb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.164891 Aug 05 10:26:56.006309 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 51/105] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:55 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:56.111620 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b23beed5-76ca-49a2-ad22-dd69953c671f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:56.112244 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b23beed5-76ca-49a2-ad22-dd69953c671f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:56.120101 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b23beed5-76ca-49a2-ad22-dd69953c671f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:56.120623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b23beed5-76ca-49a2-ad22-dd69953c671f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:56.121012 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b23beed5-76ca-49a2-ad22-dd69953c671f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:56.121704 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b23beed5-76ca-49a2-ad22-dd69953c671f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:56.122152 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b23beed5-76ca-49a2-ad22-dd69953c671f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:56.122568 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b23beed5-76ca-49a2-ad22-dd69953c671f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:56.271534 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b23beed5-76ca-49a2-ad22-dd69953c671f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:56.279371 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b23beed5-76ca-49a2-ad22-dd69953c671f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.174583 Aug 05 10:26:56.280022 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 55/106] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:56 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:56.486738 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6dc99503-8a3b-4dc7-a527-910c36df8c14 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:56.487494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6dc99503-8a3b-4dc7-a527-910c36df8c14 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:56.489528 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:26:56.495567 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6dc99503-8a3b-4dc7-a527-910c36df8c14 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:56.496042 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6dc99503-8a3b-4dc7-a527-910c36df8c14 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:56.496466 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6dc99503-8a3b-4dc7-a527-910c36df8c14 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:56.497154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6dc99503-8a3b-4dc7-a527-910c36df8c14 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:56.497656 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6dc99503-8a3b-4dc7-a527-910c36df8c14 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:56.498276 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6dc99503-8a3b-4dc7-a527-910c36df8c14 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:56.508752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-8ac742b3-cc5f-4986-a54e-55cdceeebf14 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:56.509617 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-8ac742b3-cc5f-4986-a54e-55cdceeebf14 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:56.516035 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8ac742b3-cc5f-4986-a54e-55cdceeebf14 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:56.517282 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8ac742b3-cc5f-4986-a54e-55cdceeebf14 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:56.517282 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8ac742b3-cc5f-4986-a54e-55cdceeebf14 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:56.518082 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8ac742b3-cc5f-4986-a54e-55cdceeebf14 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:56.518589 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8ac742b3-cc5f-4986-a54e-55cdceeebf14 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:56.519101 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8ac742b3-cc5f-4986-a54e-55cdceeebf14 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:56.566267 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6dc99503-8a3b-4dc7-a527-910c36df8c14 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:56.574557 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6dc99503-8a3b-4dc7-a527-910c36df8c14 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:56.576282 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6dc99503-8a3b-4dc7-a527-910c36df8c14 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:56.577507 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6dc99503-8a3b-4dc7-a527-910c36df8c14 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1341 microversion: 2.20 time: 0.095641 Aug 05 10:26:56.578158 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 52/107] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:26:56 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1341 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:26:56.656490 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-8ac742b3-cc5f-4986-a54e-55cdceeebf14 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:56.664650 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-8ac742b3-cc5f-4986-a54e-55cdceeebf14 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.160722 Aug 05 10:26:56.665327 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 56/108] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:56 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:26:56.729932 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ddf95ede-9f1a-4f3c-871d-51be7a266f67 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:56.730603 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ddf95ede-9f1a-4f3c-871d-51be7a266f67 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:56.736898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ddf95ede-9f1a-4f3c-871d-51be7a266f67 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:56.737365 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ddf95ede-9f1a-4f3c-871d-51be7a266f67 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:56.737826 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ddf95ede-9f1a-4f3c-871d-51be7a266f67 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:56.738492 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ddf95ede-9f1a-4f3c-871d-51be7a266f67 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:56.738944 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ddf95ede-9f1a-4f3c-871d-51be7a266f67 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:56.739364 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ddf95ede-9f1a-4f3c-871d-51be7a266f67 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:56.872602 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ddf95ede-9f1a-4f3c-871d-51be7a266f67 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:56.880725 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ddf95ede-9f1a-4f3c-871d-51be7a266f67 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.154822 Aug 05 10:26:56.881610 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 53/109] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:56 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:57.028062 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-763bbded-f16a-4c02-a04f-dbd191c41b52 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:57.028582 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-763bbded-f16a-4c02-a04f-dbd191c41b52 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:57.035450 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-763bbded-f16a-4c02-a04f-dbd191c41b52 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:57.035938 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-763bbded-f16a-4c02-a04f-dbd191c41b52 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:57.036717 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-763bbded-f16a-4c02-a04f-dbd191c41b52 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:57.037404 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-763bbded-f16a-4c02-a04f-dbd191c41b52 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:57.037847 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-763bbded-f16a-4c02-a04f-dbd191c41b52 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:57.038266 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-763bbded-f16a-4c02-a04f-dbd191c41b52 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:57.174620 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-763bbded-f16a-4c02-a04f-dbd191c41b52 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:57.182489 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-763bbded-f16a-4c02-a04f-dbd191c41b52 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.158284 Aug 05 10:26:57.183084 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 57/110] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:57 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:57.302174 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1b6680a0-2d4b-4038-9823-cbf669e9b7e0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:57.303152 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1b6680a0-2d4b-4038-9823-cbf669e9b7e0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:57.305159 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:26:57.310402 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b6680a0-2d4b-4038-9823-cbf669e9b7e0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:57.310968 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b6680a0-2d4b-4038-9823-cbf669e9b7e0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:57.311441 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b6680a0-2d4b-4038-9823-cbf669e9b7e0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:57.312187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b6680a0-2d4b-4038-9823-cbf669e9b7e0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:57.312734 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b6680a0-2d4b-4038-9823-cbf669e9b7e0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:57.313215 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b6680a0-2d4b-4038-9823-cbf669e9b7e0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:57.453223 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1b6680a0-2d4b-4038-9823-cbf669e9b7e0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:57.461069 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1b6680a0-2d4b-4038-9823-cbf669e9b7e0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.162866 Aug 05 10:26:57.462007 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 54/111] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:57 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:57.600118 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-0fb2ec20-a1d0-4885-b5bd-48e0bb0cfe8c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:57.600790 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-0fb2ec20-a1d0-4885-b5bd-48e0bb0cfe8c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:57.602596 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=34 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:26:57.608347 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0fb2ec20-a1d0-4885-b5bd-48e0bb0cfe8c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:57.608827 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0fb2ec20-a1d0-4885-b5bd-48e0bb0cfe8c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:57.609257 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0fb2ec20-a1d0-4885-b5bd-48e0bb0cfe8c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:57.610053 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0fb2ec20-a1d0-4885-b5bd-48e0bb0cfe8c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:57.610883 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0fb2ec20-a1d0-4885-b5bd-48e0bb0cfe8c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:57.611413 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0fb2ec20-a1d0-4885-b5bd-48e0bb0cfe8c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:57.675525 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-0fb2ec20-a1d0-4885-b5bd-48e0bb0cfe8c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:57.685442 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-0fb2ec20-a1d0-4885-b5bd-48e0bb0cfe8c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:57.686387 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a5630f17-c075-4c48-bd76-e6a5b236ace8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:57.686962 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-0fb2ec20-a1d0-4885-b5bd-48e0bb0cfe8c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:57.687089 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a5630f17-c075-4c48-bd76-e6a5b236ace8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:57.688074 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-0fb2ec20-a1d0-4885-b5bd-48e0bb0cfe8c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1341 microversion: 2.20 time: 0.092036 Aug 05 10:26:57.689083 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=4 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:26:57.689266 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 58/112] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:26:57 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1341 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:26:57.695235 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a5630f17-c075-4c48-bd76-e6a5b236ace8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:57.695719 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a5630f17-c075-4c48-bd76-e6a5b236ace8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:57.696156 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a5630f17-c075-4c48-bd76-e6a5b236ace8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:57.696858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a5630f17-c075-4c48-bd76-e6a5b236ace8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:57.697308 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a5630f17-c075-4c48-bd76-e6a5b236ace8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:57.697730 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a5630f17-c075-4c48-bd76-e6a5b236ace8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:57.834387 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a5630f17-c075-4c48-bd76-e6a5b236ace8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:57.842074 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a5630f17-c075-4c48-bd76-e6a5b236ace8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.160187 Aug 05 10:26:57.842637 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 55/113] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:57 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:26:57.901214 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-76158107-96f7-436a-9131-1d7f08ada940 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:57.901971 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-76158107-96f7-436a-9131-1d7f08ada940 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:57.908600 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-76158107-96f7-436a-9131-1d7f08ada940 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:57.909119 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-76158107-96f7-436a-9131-1d7f08ada940 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:57.909553 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-76158107-96f7-436a-9131-1d7f08ada940 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:57.910276 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-76158107-96f7-436a-9131-1d7f08ada940 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:57.910732 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-76158107-96f7-436a-9131-1d7f08ada940 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:57.911555 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-76158107-96f7-436a-9131-1d7f08ada940 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:58.048405 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-76158107-96f7-436a-9131-1d7f08ada940 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:58.058197 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-76158107-96f7-436a-9131-1d7f08ada940 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.160562 Aug 05 10:26:58.071967 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 59/114] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:57 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:58.203624 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7586bd95-0ca8-4836-8106-43e36bb224f7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:58.204360 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7586bd95-0ca8-4836-8106-43e36bb224f7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:58.212737 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7586bd95-0ca8-4836-8106-43e36bb224f7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:58.213514 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7586bd95-0ca8-4836-8106-43e36bb224f7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:58.214145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7586bd95-0ca8-4836-8106-43e36bb224f7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:58.215121 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7586bd95-0ca8-4836-8106-43e36bb224f7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:58.217154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7586bd95-0ca8-4836-8106-43e36bb224f7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:58.217869 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7586bd95-0ca8-4836-8106-43e36bb224f7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:58.355946 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7586bd95-0ca8-4836-8106-43e36bb224f7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:58.364535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7586bd95-0ca8-4836-8106-43e36bb224f7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.165744 Aug 05 10:26:58.365103 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 56/115] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:58 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:58.485108 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d851367d-a730-48a8-a362-e9d8d92804fa tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:58.486350 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d851367d-a730-48a8-a362-e9d8d92804fa tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:58.493249 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d851367d-a730-48a8-a362-e9d8d92804fa tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:58.493975 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d851367d-a730-48a8-a362-e9d8d92804fa tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:58.494685 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d851367d-a730-48a8-a362-e9d8d92804fa tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:58.496052 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d851367d-a730-48a8-a362-e9d8d92804fa tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:58.496559 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d851367d-a730-48a8-a362-e9d8d92804fa tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:58.497249 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d851367d-a730-48a8-a362-e9d8d92804fa tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:58.711852 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-99d9b453-e6ab-4e6a-adb3-9329c6fe6856 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:58.713339 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-99d9b453-e6ab-4e6a-adb3-9329c6fe6856 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:58.720009 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99d9b453-e6ab-4e6a-adb3-9329c6fe6856 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:58.720703 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99d9b453-e6ab-4e6a-adb3-9329c6fe6856 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:58.721352 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99d9b453-e6ab-4e6a-adb3-9329c6fe6856 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:58.722035 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99d9b453-e6ab-4e6a-adb3-9329c6fe6856 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:58.722790 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99d9b453-e6ab-4e6a-adb3-9329c6fe6856 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:58.723511 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99d9b453-e6ab-4e6a-adb3-9329c6fe6856 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:58.798560 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-99d9b453-e6ab-4e6a-adb3-9329c6fe6856 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:58.807488 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-99d9b453-e6ab-4e6a-adb3-9329c6fe6856 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:58.809073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-99d9b453-e6ab-4e6a-adb3-9329c6fe6856 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:58.810436 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-99d9b453-e6ab-4e6a-adb3-9329c6fe6856 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1339 microversion: 2.20 time: 0.102939 Aug 05 10:26:58.811598 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 57/116] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:26:58 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1339 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:26:58.863205 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-018d8e6b-35ed-4a36-8337-448339c63d37 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:58.864289 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-018d8e6b-35ed-4a36-8337-448339c63d37 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:58.871231 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-018d8e6b-35ed-4a36-8337-448339c63d37 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:58.871786 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-018d8e6b-35ed-4a36-8337-448339c63d37 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:58.872232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-018d8e6b-35ed-4a36-8337-448339c63d37 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:58.872906 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-018d8e6b-35ed-4a36-8337-448339c63d37 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:58.873586 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-018d8e6b-35ed-4a36-8337-448339c63d37 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:58.874481 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-018d8e6b-35ed-4a36-8337-448339c63d37 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:59.099446 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-018d8e6b-35ed-4a36-8337-448339c63d37 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:59.108711 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d851367d-a730-48a8-a362-e9d8d92804fa tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:59.120835 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d851367d-a730-48a8-a362-e9d8d92804fa tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.640010 Aug 05 10:26:59.121569 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 60/117] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:58 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:59.121718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-018d8e6b-35ed-4a36-8337-448339c63d37 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.262646 Aug 05 10:26:59.134981 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 58/118] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:58 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:59.141424 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c336c09a-28b5-482e-977a-f240a7d21822 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:59.142067 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c336c09a-28b5-482e-977a-f240a7d21822 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:59.149790 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c336c09a-28b5-482e-977a-f240a7d21822 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:59.151958 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c336c09a-28b5-482e-977a-f240a7d21822 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:59.152727 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c336c09a-28b5-482e-977a-f240a7d21822 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:59.153588 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c336c09a-28b5-482e-977a-f240a7d21822 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:59.154178 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c336c09a-28b5-482e-977a-f240a7d21822 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:59.155416 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c336c09a-28b5-482e-977a-f240a7d21822 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:59.372774 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c336c09a-28b5-482e-977a-f240a7d21822 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:59.387591 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-39c8a571-e8c4-4db1-bffe-871627ebfb50 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:59.388568 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-39c8a571-e8c4-4db1-bffe-871627ebfb50 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:59.401553 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c336c09a-28b5-482e-977a-f240a7d21822 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.276257 Aug 05 10:26:59.402895 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 61/119] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:59 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:59.403964 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39c8a571-e8c4-4db1-bffe-871627ebfb50 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:59.404600 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39c8a571-e8c4-4db1-bffe-871627ebfb50 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:59.405762 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39c8a571-e8c4-4db1-bffe-871627ebfb50 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:59.406633 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39c8a571-e8c4-4db1-bffe-871627ebfb50 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:59.407343 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39c8a571-e8c4-4db1-bffe-871627ebfb50 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:59.408724 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39c8a571-e8c4-4db1-bffe-871627ebfb50 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:59.589491 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-6b397110-f56b-4462-a3a1-4a5ca5a23266 req-a51a3032-8ba1-4398-be20-c7e6f3617778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ffbb1e1-7319-4e06-8218-45198955c4fc", "name": "network-vif-plugged", "status": "completed", "tag": "879cd29f-43ad-44a3-9710-970b15b11ed9"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:26:59.606305 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-6b397110-f56b-4462-a3a1-4a5ca5a23266 req-a51a3032-8ba1-4398-be20-c7e6f3617778 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:59.606795 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-6b397110-f56b-4462-a3a1-4a5ca5a23266 req-a51a3032-8ba1-4398-be20-c7e6f3617778 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:59.607253 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-6b397110-f56b-4462-a3a1-4a5ca5a23266 req-a51a3032-8ba1-4398-be20-c7e6f3617778 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:59.621487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-39c8a571-e8c4-4db1-bffe-871627ebfb50 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:59.624896 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-6b397110-f56b-4462-a3a1-4a5ca5a23266 req-a51a3032-8ba1-4398-be20-c7e6f3617778 service nova] Creating event network-vif-plugged:879cd29f-43ad-44a3-9710-970b15b11ed9 for instance 5ffbb1e1-7319-4e06-8218-45198955c4fc on hv-cinder-81558 Aug 05 10:26:59.629361 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-39c8a571-e8c4-4db1-bffe-871627ebfb50 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.247395 Aug 05 10:26:59.630274 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 59/120] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:26:59 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:26:59.631502 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-6b397110-f56b-4462-a3a1-4a5ca5a23266 req-a51a3032-8ba1-4398-be20-c7e6f3617778 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127846 Aug 05 10:26:59.632162 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 62/121] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:26:59.834201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ad4b6d9a-5dbb-4edd-91af-32f90ff92203 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:26:59.834789 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ad4b6d9a-5dbb-4edd-91af-32f90ff92203 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:26:59.840747 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad4b6d9a-5dbb-4edd-91af-32f90ff92203 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:59.841222 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad4b6d9a-5dbb-4edd-91af-32f90ff92203 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:59.841643 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad4b6d9a-5dbb-4edd-91af-32f90ff92203 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:59.842328 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad4b6d9a-5dbb-4edd-91af-32f90ff92203 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:26:59.842766 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad4b6d9a-5dbb-4edd-91af-32f90ff92203 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:26:59.843191 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad4b6d9a-5dbb-4edd-91af-32f90ff92203 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:26:59.910182 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ad4b6d9a-5dbb-4edd-91af-32f90ff92203 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:59.918485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ad4b6d9a-5dbb-4edd-91af-32f90ff92203 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:59.919988 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ad4b6d9a-5dbb-4edd-91af-32f90ff92203 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:26:59.921059 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ad4b6d9a-5dbb-4edd-91af-32f90ff92203 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1339 microversion: 2.20 time: 0.090822 Aug 05 10:26:59.921607 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 60/122] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:26:59 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1339 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:00.143743 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ea4431bc-1a61-4289-bad9-b116f5db7bd0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:00.144428 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-ea4431bc-1a61-4289-bad9-b116f5db7bd0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:00.144666 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-27e992cc-e206-489c-9fe6-ab520e2dd37e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:00.145269 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-27e992cc-e206-489c-9fe6-ab520e2dd37e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:00.150697 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ea4431bc-1a61-4289-bad9-b116f5db7bd0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:00.151974 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ea4431bc-1a61-4289-bad9-b116f5db7bd0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:00.152204 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ea4431bc-1a61-4289-bad9-b116f5db7bd0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:00.152721 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ea4431bc-1a61-4289-bad9-b116f5db7bd0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:00.153168 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ea4431bc-1a61-4289-bad9-b116f5db7bd0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:00.153579 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ea4431bc-1a61-4289-bad9-b116f5db7bd0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:00.165793 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27e992cc-e206-489c-9fe6-ab520e2dd37e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:00.166286 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27e992cc-e206-489c-9fe6-ab520e2dd37e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:00.166766 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27e992cc-e206-489c-9fe6-ab520e2dd37e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:00.167635 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27e992cc-e206-489c-9fe6-ab520e2dd37e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:00.168228 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27e992cc-e206-489c-9fe6-ab520e2dd37e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:00.168805 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27e992cc-e206-489c-9fe6-ab520e2dd37e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:00.322253 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-27e992cc-e206-489c-9fe6-ab520e2dd37e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:00.330225 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-27e992cc-e206-489c-9fe6-ab520e2dd37e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.191897 Aug 05 10:27:00.331050 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 61/123] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:00 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:00.426934 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2210a614-ebf4-40b5-878f-b663866ae851 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:00.427570 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2210a614-ebf4-40b5-878f-b663866ae851 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:00.434967 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2210a614-ebf4-40b5-878f-b663866ae851 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:00.435455 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2210a614-ebf4-40b5-878f-b663866ae851 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:00.435881 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2210a614-ebf4-40b5-878f-b663866ae851 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:00.436572 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2210a614-ebf4-40b5-878f-b663866ae851 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:00.447192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2210a614-ebf4-40b5-878f-b663866ae851 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:00.447680 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2210a614-ebf4-40b5-878f-b663866ae851 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:00.506376 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ea4431bc-1a61-4289-bad9-b116f5db7bd0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:00.514200 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ea4431bc-1a61-4289-bad9-b116f5db7bd0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.376298 Aug 05 10:27:00.514737 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 63/124] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:00 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:00.622457 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2210a614-ebf4-40b5-878f-b663866ae851 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:00.638980 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2210a614-ebf4-40b5-878f-b663866ae851 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.217039 Aug 05 10:27:00.639769 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 62/125] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:00 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:00.656432 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-594cf72e-e911-4bd7-8851-902e45fc0215 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:00.657136 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-594cf72e-e911-4bd7-8851-902e45fc0215 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:00.663970 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-594cf72e-e911-4bd7-8851-902e45fc0215 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:00.664450 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-594cf72e-e911-4bd7-8851-902e45fc0215 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:00.664895 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-594cf72e-e911-4bd7-8851-902e45fc0215 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:00.665576 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-594cf72e-e911-4bd7-8851-902e45fc0215 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:00.666115 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-594cf72e-e911-4bd7-8851-902e45fc0215 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:00.666733 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-594cf72e-e911-4bd7-8851-902e45fc0215 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:00.797693 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-594cf72e-e911-4bd7-8851-902e45fc0215 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:00.805224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-594cf72e-e911-4bd7-8851-902e45fc0215 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.152926 Aug 05 10:27:00.805799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 64/126] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:00 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:00.942877 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f584da5a-ed0f-4f87-ab3d-68cfc53e5737 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:00.943686 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f584da5a-ed0f-4f87-ab3d-68cfc53e5737 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:00.950802 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f584da5a-ed0f-4f87-ab3d-68cfc53e5737 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:00.951938 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f584da5a-ed0f-4f87-ab3d-68cfc53e5737 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:00.952373 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f584da5a-ed0f-4f87-ab3d-68cfc53e5737 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:00.953079 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f584da5a-ed0f-4f87-ab3d-68cfc53e5737 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:00.953524 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f584da5a-ed0f-4f87-ab3d-68cfc53e5737 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:00.954000 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f584da5a-ed0f-4f87-ab3d-68cfc53e5737 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:00.959618 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:27:01.018111 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f584da5a-ed0f-4f87-ab3d-68cfc53e5737 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:01.026412 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f584da5a-ed0f-4f87-ab3d-68cfc53e5737 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:01.027871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f584da5a-ed0f-4f87-ab3d-68cfc53e5737 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:01.028935 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f584da5a-ed0f-4f87-ab3d-68cfc53e5737 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1339 microversion: 2.20 time: 0.090106 Aug 05 10:27:01.029674 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 63/127] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:00 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1339 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:01.350805 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f9531084-e9b4-43ab-8b78-ee0035ebcb3c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:01.351308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f9531084-e9b4-43ab-8b78-ee0035ebcb3c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:01.358644 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f9531084-e9b4-43ab-8b78-ee0035ebcb3c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:01.359161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f9531084-e9b4-43ab-8b78-ee0035ebcb3c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:01.359598 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f9531084-e9b4-43ab-8b78-ee0035ebcb3c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:01.360332 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f9531084-e9b4-43ab-8b78-ee0035ebcb3c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:01.361475 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f9531084-e9b4-43ab-8b78-ee0035ebcb3c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:01.361902 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f9531084-e9b4-43ab-8b78-ee0035ebcb3c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:01.494752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-f9531084-e9b4-43ab-8b78-ee0035ebcb3c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:01.503360 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f9531084-e9b4-43ab-8b78-ee0035ebcb3c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.156546 Aug 05 10:27:01.503932 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 65/128] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:01 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:01.537780 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1e3b1c48-8178-4f73-865a-c91fedd6c691 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:01.538385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1e3b1c48-8178-4f73-865a-c91fedd6c691 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:01.544502 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e3b1c48-8178-4f73-865a-c91fedd6c691 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:01.544964 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e3b1c48-8178-4f73-865a-c91fedd6c691 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:01.545385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e3b1c48-8178-4f73-865a-c91fedd6c691 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:01.546073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e3b1c48-8178-4f73-865a-c91fedd6c691 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:01.546515 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e3b1c48-8178-4f73-865a-c91fedd6c691 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:01.546938 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e3b1c48-8178-4f73-865a-c91fedd6c691 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:01.661625 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-93f0d346-a18b-48c2-83c4-bc51fc3a70d7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:01.662582 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-93f0d346-a18b-48c2-83c4-bc51fc3a70d7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:01.671762 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-93f0d346-a18b-48c2-83c4-bc51fc3a70d7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:01.676917 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-93f0d346-a18b-48c2-83c4-bc51fc3a70d7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:01.677662 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-93f0d346-a18b-48c2-83c4-bc51fc3a70d7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:01.678606 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-93f0d346-a18b-48c2-83c4-bc51fc3a70d7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:01.679519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-93f0d346-a18b-48c2-83c4-bc51fc3a70d7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:01.681499 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-93f0d346-a18b-48c2-83c4-bc51fc3a70d7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:01.696493 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1e3b1c48-8178-4f73-865a-c91fedd6c691 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:01.705054 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1e3b1c48-8178-4f73-865a-c91fedd6c691 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.171249 Aug 05 10:27:01.705655 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 64/129] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:01 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:01.828515 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c70e2e33-26ea-48da-af3c-7430952080d0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:01.830024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c70e2e33-26ea-48da-af3c-7430952080d0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:01.839140 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c70e2e33-26ea-48da-af3c-7430952080d0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:01.839874 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c70e2e33-26ea-48da-af3c-7430952080d0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:01.840574 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c70e2e33-26ea-48da-af3c-7430952080d0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:01.842029 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c70e2e33-26ea-48da-af3c-7430952080d0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:01.842756 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c70e2e33-26ea-48da-af3c-7430952080d0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:01.843394 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c70e2e33-26ea-48da-af3c-7430952080d0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:01.900302 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-93f0d346-a18b-48c2-83c4-bc51fc3a70d7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:01.913871 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-93f0d346-a18b-48c2-83c4-bc51fc3a70d7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.256737 Aug 05 10:27:01.914865 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 66/130] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:01 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:27:01.999387 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c70e2e33-26ea-48da-af3c-7430952080d0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:02.007709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c70e2e33-26ea-48da-af3c-7430952080d0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.185400 Aug 05 10:27:02.008642 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 65/131] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:01 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:27:02.051825 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-54707e07-ed43-438e-9bbd-6c0362515e32 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:02.052516 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-54707e07-ed43-438e-9bbd-6c0362515e32 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:02.059418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-54707e07-ed43-438e-9bbd-6c0362515e32 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:02.059904 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-54707e07-ed43-438e-9bbd-6c0362515e32 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:02.060339 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-54707e07-ed43-438e-9bbd-6c0362515e32 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:02.061058 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-54707e07-ed43-438e-9bbd-6c0362515e32 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:02.061496 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-54707e07-ed43-438e-9bbd-6c0362515e32 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:02.061920 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-54707e07-ed43-438e-9bbd-6c0362515e32 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:02.143049 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-54707e07-ed43-438e-9bbd-6c0362515e32 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:02.159771 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-54707e07-ed43-438e-9bbd-6c0362515e32 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:02.161818 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-54707e07-ed43-438e-9bbd-6c0362515e32 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:02.162991 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-54707e07-ed43-438e-9bbd-6c0362515e32 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1339 microversion: 2.20 time: 0.115226 Aug 05 10:27:02.163933 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 67/132] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:02 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1339 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:02.523947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fb6ca01a-57c2-4a86-82eb-35c94257c86e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:02.524528 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fb6ca01a-57c2-4a86-82eb-35c94257c86e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:02.531029 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb6ca01a-57c2-4a86-82eb-35c94257c86e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:02.531539 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb6ca01a-57c2-4a86-82eb-35c94257c86e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:02.531977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb6ca01a-57c2-4a86-82eb-35c94257c86e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:02.533067 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb6ca01a-57c2-4a86-82eb-35c94257c86e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:02.533517 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb6ca01a-57c2-4a86-82eb-35c94257c86e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:02.534092 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb6ca01a-57c2-4a86-82eb-35c94257c86e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:02.679816 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fb6ca01a-57c2-4a86-82eb-35c94257c86e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:02.687427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fb6ca01a-57c2-4a86-82eb-35c94257c86e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.167413 Aug 05 10:27:02.687995 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 66/133] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:02 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:02.725075 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d0454ca6-fac8-4d63-895f-712b483ce48a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:02.725682 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d0454ca6-fac8-4d63-895f-712b483ce48a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:02.731591 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d0454ca6-fac8-4d63-895f-712b483ce48a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:02.732058 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d0454ca6-fac8-4d63-895f-712b483ce48a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:02.732483 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d0454ca6-fac8-4d63-895f-712b483ce48a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:02.733157 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d0454ca6-fac8-4d63-895f-712b483ce48a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:02.733596 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d0454ca6-fac8-4d63-895f-712b483ce48a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:02.734011 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d0454ca6-fac8-4d63-895f-712b483ce48a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:02.867773 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d0454ca6-fac8-4d63-895f-712b483ce48a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:02.875228 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d0454ca6-fac8-4d63-895f-712b483ce48a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.153975 Aug 05 10:27:02.875931 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 68/134] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:02 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:02.934499 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-666c4884-cda4-4db5-8fc5-909dae1afbf6 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:02.935239 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-666c4884-cda4-4db5-8fc5-909dae1afbf6 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:02.942235 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-666c4884-cda4-4db5-8fc5-909dae1afbf6 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:02.942707 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-666c4884-cda4-4db5-8fc5-909dae1afbf6 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:02.943156 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-666c4884-cda4-4db5-8fc5-909dae1afbf6 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:02.943839 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-666c4884-cda4-4db5-8fc5-909dae1afbf6 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:02.944276 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-666c4884-cda4-4db5-8fc5-909dae1afbf6 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:02.944685 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-666c4884-cda4-4db5-8fc5-909dae1afbf6 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:03.029829 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-7dcee927-ce83-42dd-ac77-8e421172a0f8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:03.030503 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-7dcee927-ce83-42dd-ac77-8e421172a0f8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:03.038731 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7dcee927-ce83-42dd-ac77-8e421172a0f8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:03.039238 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7dcee927-ce83-42dd-ac77-8e421172a0f8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:03.039665 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7dcee927-ce83-42dd-ac77-8e421172a0f8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:03.040358 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7dcee927-ce83-42dd-ac77-8e421172a0f8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:03.040820 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7dcee927-ce83-42dd-ac77-8e421172a0f8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:03.041221 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7dcee927-ce83-42dd-ac77-8e421172a0f8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:03.087072 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-666c4884-cda4-4db5-8fc5-909dae1afbf6 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:03.095102 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-666c4884-cda4-4db5-8fc5-909dae1afbf6 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.164532 Aug 05 10:27:03.096011 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 67/135] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:02 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:03.185061 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a2ebd32e-4574-465c-9989-b39fa6f832a6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:03.185669 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a2ebd32e-4574-465c-9989-b39fa6f832a6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:03.192007 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a2ebd32e-4574-465c-9989-b39fa6f832a6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:03.192510 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a2ebd32e-4574-465c-9989-b39fa6f832a6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:03.192941 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a2ebd32e-4574-465c-9989-b39fa6f832a6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:03.193631 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a2ebd32e-4574-465c-9989-b39fa6f832a6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:03.194074 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a2ebd32e-4574-465c-9989-b39fa6f832a6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:03.194511 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a2ebd32e-4574-465c-9989-b39fa6f832a6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:03.200635 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-7dcee927-ce83-42dd-ac77-8e421172a0f8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:03.208471 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-7dcee927-ce83-42dd-ac77-8e421172a0f8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.183116 Aug 05 10:27:03.209043 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 69/136] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:03 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:03.257755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a2ebd32e-4574-465c-9989-b39fa6f832a6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:03.265711 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a2ebd32e-4574-465c-9989-b39fa6f832a6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:03.267313 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a2ebd32e-4574-465c-9989-b39fa6f832a6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:03.268401 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a2ebd32e-4574-465c-9989-b39fa6f832a6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1339 microversion: 2.20 time: 0.087613 Aug 05 10:27:03.268954 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 68/137] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:03 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1339 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:03.710393 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-dd2abbda-639d-4296-9f04-de78ee792540 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:03.711102 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-dd2abbda-639d-4296-9f04-de78ee792540 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:03.718340 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dd2abbda-639d-4296-9f04-de78ee792540 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:03.718875 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dd2abbda-639d-4296-9f04-de78ee792540 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:03.719937 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dd2abbda-639d-4296-9f04-de78ee792540 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:03.721466 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dd2abbda-639d-4296-9f04-de78ee792540 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:03.722150 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dd2abbda-639d-4296-9f04-de78ee792540 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:03.722801 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dd2abbda-639d-4296-9f04-de78ee792540 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:03.867991 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-dd2abbda-639d-4296-9f04-de78ee792540 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:03.871557 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=100 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:27:03.876898 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-dd2abbda-639d-4296-9f04-de78ee792540 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.170879 Aug 05 10:27:03.877465 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 70/138] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:03 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:03.896140 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-33845a15-ebd1-467d-92a1-68e55573c853 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:03.896737 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-33845a15-ebd1-467d-92a1-68e55573c853 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:03.902828 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33845a15-ebd1-467d-92a1-68e55573c853 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:03.903363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33845a15-ebd1-467d-92a1-68e55573c853 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:03.903758 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33845a15-ebd1-467d-92a1-68e55573c853 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:03.904450 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33845a15-ebd1-467d-92a1-68e55573c853 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:03.904874 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33845a15-ebd1-467d-92a1-68e55573c853 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:03.905282 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33845a15-ebd1-467d-92a1-68e55573c853 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:04.040418 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-33845a15-ebd1-467d-92a1-68e55573c853 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:04.048384 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-33845a15-ebd1-467d-92a1-68e55573c853 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.156002 Aug 05 10:27:04.048969 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 69/139] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:03 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:04.117264 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-66a6ac38-79cb-48f4-8813-4755a957e558 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:04.118105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-66a6ac38-79cb-48f4-8813-4755a957e558 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:04.124361 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-66a6ac38-79cb-48f4-8813-4755a957e558 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:04.124845 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-66a6ac38-79cb-48f4-8813-4755a957e558 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:04.125281 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-66a6ac38-79cb-48f4-8813-4755a957e558 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:04.126230 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-66a6ac38-79cb-48f4-8813-4755a957e558 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:04.126706 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-66a6ac38-79cb-48f4-8813-4755a957e558 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:04.127254 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-66a6ac38-79cb-48f4-8813-4755a957e558 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:04.228933 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2e2a7581-9828-4c1c-a68c-71afae350ee8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:04.229528 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2e2a7581-9828-4c1c-a68c-71afae350ee8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:04.235777 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e2a7581-9828-4c1c-a68c-71afae350ee8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:04.236409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e2a7581-9828-4c1c-a68c-71afae350ee8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:04.236838 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e2a7581-9828-4c1c-a68c-71afae350ee8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:04.237523 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e2a7581-9828-4c1c-a68c-71afae350ee8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:04.237967 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e2a7581-9828-4c1c-a68c-71afae350ee8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:04.238379 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e2a7581-9828-4c1c-a68c-71afae350ee8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:04.266256 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-66a6ac38-79cb-48f4-8813-4755a957e558 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:04.273912 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-66a6ac38-79cb-48f4-8813-4755a957e558 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.161562 Aug 05 10:27:04.274739 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 71/140] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:04 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:04.291907 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-df3fefb5-94ce-4c37-baa8-f5d87366fff5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:04.292365 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-df3fefb5-94ce-4c37-baa8-f5d87366fff5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:04.299652 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-df3fefb5-94ce-4c37-baa8-f5d87366fff5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:04.300138 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-df3fefb5-94ce-4c37-baa8-f5d87366fff5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:04.300573 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-df3fefb5-94ce-4c37-baa8-f5d87366fff5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:04.301256 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-df3fefb5-94ce-4c37-baa8-f5d87366fff5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:04.301890 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-df3fefb5-94ce-4c37-baa8-f5d87366fff5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:04.302315 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-df3fefb5-94ce-4c37-baa8-f5d87366fff5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:04.372959 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-df3fefb5-94ce-4c37-baa8-f5d87366fff5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:04.382409 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-df3fefb5-94ce-4c37-baa8-f5d87366fff5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:04.383413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2e2a7581-9828-4c1c-a68c-71afae350ee8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:04.383844 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-df3fefb5-94ce-4c37-baa8-f5d87366fff5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:04.385271 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-df3fefb5-94ce-4c37-baa8-f5d87366fff5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1339 microversion: 2.20 time: 0.098043 Aug 05 10:27:04.385845 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 72/141] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:04 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1339 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 10:27:04.394667 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2e2a7581-9828-4c1c-a68c-71afae350ee8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.169475 Aug 05 10:27:04.395275 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 70/142] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:04 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:27:04.898154 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-73fcf8fb-b54c-40dc-981a-6cf1721c9ef7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:04.899227 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-73fcf8fb-b54c-40dc-981a-6cf1721c9ef7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:04.905026 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-73fcf8fb-b54c-40dc-981a-6cf1721c9ef7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:04.905499 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-73fcf8fb-b54c-40dc-981a-6cf1721c9ef7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:04.905915 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-73fcf8fb-b54c-40dc-981a-6cf1721c9ef7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:04.906597 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-73fcf8fb-b54c-40dc-981a-6cf1721c9ef7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:04.907068 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-73fcf8fb-b54c-40dc-981a-6cf1721c9ef7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:04.907482 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-73fcf8fb-b54c-40dc-981a-6cf1721c9ef7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:05.041661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-73fcf8fb-b54c-40dc-981a-6cf1721c9ef7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:05.050097 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-73fcf8fb-b54c-40dc-981a-6cf1721c9ef7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.155784 Aug 05 10:27:05.050705 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 73/143] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:04 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:05.068856 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3e03696c-6c58-4a1a-ac21-858ae585e878 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:05.069902 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3e03696c-6c58-4a1a-ac21-858ae585e878 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:05.076620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e03696c-6c58-4a1a-ac21-858ae585e878 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:05.077138 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e03696c-6c58-4a1a-ac21-858ae585e878 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:05.077594 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e03696c-6c58-4a1a-ac21-858ae585e878 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:05.078266 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e03696c-6c58-4a1a-ac21-858ae585e878 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:05.078727 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e03696c-6c58-4a1a-ac21-858ae585e878 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:05.079169 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e03696c-6c58-4a1a-ac21-858ae585e878 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:05.214756 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3e03696c-6c58-4a1a-ac21-858ae585e878 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:05.223249 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3e03696c-6c58-4a1a-ac21-858ae585e878 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.158836 Aug 05 10:27:05.223852 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 71/144] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:05 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:05.298440 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-cbc927d4-ade8-403f-9240-22a28a302df2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:05.298440 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-cbc927d4-ade8-403f-9240-22a28a302df2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:05.301371 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=100 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:27:05.305079 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cbc927d4-ade8-403f-9240-22a28a302df2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:05.305752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cbc927d4-ade8-403f-9240-22a28a302df2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:05.306183 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cbc927d4-ade8-403f-9240-22a28a302df2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:05.307061 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cbc927d4-ade8-403f-9240-22a28a302df2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:05.307705 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cbc927d4-ade8-403f-9240-22a28a302df2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:05.309809 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cbc927d4-ade8-403f-9240-22a28a302df2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:05.408242 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7fb57ce6-7234-4ea7-b792-ba2b73da17f7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:05.409164 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7fb57ce6-7234-4ea7-b792-ba2b73da17f7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:05.419436 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7fb57ce6-7234-4ea7-b792-ba2b73da17f7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:05.420125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7fb57ce6-7234-4ea7-b792-ba2b73da17f7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:05.420661 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7fb57ce6-7234-4ea7-b792-ba2b73da17f7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:05.421596 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7fb57ce6-7234-4ea7-b792-ba2b73da17f7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:05.422116 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7fb57ce6-7234-4ea7-b792-ba2b73da17f7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:05.422627 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7fb57ce6-7234-4ea7-b792-ba2b73da17f7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:05.463774 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-cbc927d4-ade8-403f-9240-22a28a302df2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:05.472617 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-cbc927d4-ade8-403f-9240-22a28a302df2 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.180930 Aug 05 10:27:05.473205 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 74/145] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:05 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:05.478187 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f765e4f9-7666-4010-ae43-33be6a7b2b5d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:05.478968 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f765e4f9-7666-4010-ae43-33be6a7b2b5d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:05.485596 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f765e4f9-7666-4010-ae43-33be6a7b2b5d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:05.486241 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f765e4f9-7666-4010-ae43-33be6a7b2b5d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:05.487499 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f765e4f9-7666-4010-ae43-33be6a7b2b5d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:05.488303 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f765e4f9-7666-4010-ae43-33be6a7b2b5d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:05.489309 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f765e4f9-7666-4010-ae43-33be6a7b2b5d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:05.489918 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f765e4f9-7666-4010-ae43-33be6a7b2b5d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:05.492140 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7fb57ce6-7234-4ea7-b792-ba2b73da17f7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:05.502603 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7fb57ce6-7234-4ea7-b792-ba2b73da17f7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:05.504367 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7fb57ce6-7234-4ea7-b792-ba2b73da17f7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:05.505465 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7fb57ce6-7234-4ea7-b792-ba2b73da17f7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1339 microversion: 2.20 time: 0.101819 Aug 05 10:27:05.506021 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 72/146] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:05 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1339 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:05.622193 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-f765e4f9-7666-4010-ae43-33be6a7b2b5d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:05.630577 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f765e4f9-7666-4010-ae43-33be6a7b2b5d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.156115 Aug 05 10:27:05.631118 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 75/147] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:05 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:06.073436 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dcd3138d-4981-4602-9b68-f30cdc1d4391 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:06.074320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dcd3138d-4981-4602-9b68-f30cdc1d4391 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:06.082114 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dcd3138d-4981-4602-9b68-f30cdc1d4391 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:06.082611 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dcd3138d-4981-4602-9b68-f30cdc1d4391 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:06.083091 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dcd3138d-4981-4602-9b68-f30cdc1d4391 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:06.083786 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dcd3138d-4981-4602-9b68-f30cdc1d4391 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:06.084417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dcd3138d-4981-4602-9b68-f30cdc1d4391 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:06.084877 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dcd3138d-4981-4602-9b68-f30cdc1d4391 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:06.178092 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-527d6ebf-4fa2-4d28-bbc6-3e32ecd486f0 req-1bd58db6-e815-4e77-996e-ccac737a86db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7ae11ba-1225-48ce-b816-2e84d1778111", "name": "network-vif-plugged", "status": "completed", "tag": "b0d6ae53-174d-4155-9329-092d0984bc0d"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:27:06.198681 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-527d6ebf-4fa2-4d28-bbc6-3e32ecd486f0 req-1bd58db6-e815-4e77-996e-ccac737a86db service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:06.199759 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-527d6ebf-4fa2-4d28-bbc6-3e32ecd486f0 req-1bd58db6-e815-4e77-996e-ccac737a86db service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:06.200710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-527d6ebf-4fa2-4d28-bbc6-3e32ecd486f0 req-1bd58db6-e815-4e77-996e-ccac737a86db service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:06.219190 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-527d6ebf-4fa2-4d28-bbc6-3e32ecd486f0 req-1bd58db6-e815-4e77-996e-ccac737a86db service nova] Creating event network-vif-plugged:b0d6ae53-174d-4155-9329-092d0984bc0d for instance a7ae11ba-1225-48ce-b816-2e84d1778111 on hv-cinder-81558 Aug 05 10:27:06.226267 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-527d6ebf-4fa2-4d28-bbc6-3e32ecd486f0 req-1bd58db6-e815-4e77-996e-ccac737a86db service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057349 Aug 05 10:27:06.227686 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 76/148] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:27:06.260750 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-6ae1ed86-f54d-4ee0-a7d4-8a4931283537 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:06.265557 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-6ae1ed86-f54d-4ee0-a7d4-8a4931283537 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:06.275858 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6ae1ed86-f54d-4ee0-a7d4-8a4931283537 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:06.276451 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6ae1ed86-f54d-4ee0-a7d4-8a4931283537 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:06.276934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6ae1ed86-f54d-4ee0-a7d4-8a4931283537 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:06.277709 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6ae1ed86-f54d-4ee0-a7d4-8a4931283537 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:06.278222 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6ae1ed86-f54d-4ee0-a7d4-8a4931283537 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:06.278994 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6ae1ed86-f54d-4ee0-a7d4-8a4931283537 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:06.376290 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dcd3138d-4981-4602-9b68-f30cdc1d4391 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:06.385243 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dcd3138d-4981-4602-9b68-f30cdc1d4391 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.316233 Aug 05 10:27:06.385750 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 73/149] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:06 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:06.502155 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1e900a4e-7820-46f9-86fd-840342e90372 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:06.504762 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1e900a4e-7820-46f9-86fd-840342e90372 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:06.519755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e900a4e-7820-46f9-86fd-840342e90372 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:06.523159 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e900a4e-7820-46f9-86fd-840342e90372 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:06.525145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e900a4e-7820-46f9-86fd-840342e90372 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:06.526068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e900a4e-7820-46f9-86fd-840342e90372 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:06.527254 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e900a4e-7820-46f9-86fd-840342e90372 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:06.529795 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e900a4e-7820-46f9-86fd-840342e90372 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:06.815203 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-6ae1ed86-f54d-4ee0-a7d4-8a4931283537 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:06.824475 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-6ae1ed86-f54d-4ee0-a7d4-8a4931283537 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.570276 Aug 05 10:27:06.839170 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1e900a4e-7820-46f9-86fd-840342e90372 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:06.840701 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 77/150] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:06 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:06.846598 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f009ed9a-3582-4df1-bd52-ad6c12806d6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:06.847425 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f009ed9a-3582-4df1-bd52-ad6c12806d6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:06.853810 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1e900a4e-7820-46f9-86fd-840342e90372 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.362859 Aug 05 10:27:06.863267 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 74/151] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:06 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:06.863663 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f009ed9a-3582-4df1-bd52-ad6c12806d6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:06.863663 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f009ed9a-3582-4df1-bd52-ad6c12806d6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:06.863663 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f009ed9a-3582-4df1-bd52-ad6c12806d6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:06.863663 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f009ed9a-3582-4df1-bd52-ad6c12806d6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:06.863936 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f009ed9a-3582-4df1-bd52-ad6c12806d6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:06.863936 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f009ed9a-3582-4df1-bd52-ad6c12806d6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:06.872438 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d2d4cc9f-4e23-4df4-a0f6-9441df344595 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:06.873006 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d2d4cc9f-4e23-4df4-a0f6-9441df344595 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:06.888854 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2d4cc9f-4e23-4df4-a0f6-9441df344595 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:06.889294 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2d4cc9f-4e23-4df4-a0f6-9441df344595 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:06.894687 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2d4cc9f-4e23-4df4-a0f6-9441df344595 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:06.898809 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2d4cc9f-4e23-4df4-a0f6-9441df344595 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:06.899507 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2d4cc9f-4e23-4df4-a0f6-9441df344595 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:06.900284 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2d4cc9f-4e23-4df4-a0f6-9441df344595 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:07.145050 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-f009ed9a-3582-4df1-bd52-ad6c12806d6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:07.156829 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-f009ed9a-3582-4df1-bd52-ad6c12806d6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:07.164270 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-f009ed9a-3582-4df1-bd52-ad6c12806d6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:07.165473 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f009ed9a-3582-4df1-bd52-ad6c12806d6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1339 microversion: 2.20 time: 0.323522 Aug 05 10:27:07.169229 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 78/152] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:06 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1339 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:07.283925 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d2d4cc9f-4e23-4df4-a0f6-9441df344595 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:07.297751 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d2d4cc9f-4e23-4df4-a0f6-9441df344595 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.441403 Aug 05 10:27:07.299985 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 75/153] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:06 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:07.405747 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-87b0862d-5e26-4be7-938f-9cb50b5f5e86 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:07.406343 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-87b0862d-5e26-4be7-938f-9cb50b5f5e86 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:07.420017 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-87b0862d-5e26-4be7-938f-9cb50b5f5e86 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:07.420891 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-87b0862d-5e26-4be7-938f-9cb50b5f5e86 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:07.421953 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-87b0862d-5e26-4be7-938f-9cb50b5f5e86 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:07.423153 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-87b0862d-5e26-4be7-938f-9cb50b5f5e86 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:07.424222 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-87b0862d-5e26-4be7-938f-9cb50b5f5e86 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:07.426317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-87b0862d-5e26-4be7-938f-9cb50b5f5e86 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:07.816669 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-87b0862d-5e26-4be7-938f-9cb50b5f5e86 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:07.824983 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-87b0862d-5e26-4be7-938f-9cb50b5f5e86 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.423147 Aug 05 10:27:07.825708 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 79/154] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:07 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:07.845559 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6116362a-3dbc-4554-ad3c-c2d37ca5dbbc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:07.846449 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6116362a-3dbc-4554-ad3c-c2d37ca5dbbc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:07.852741 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6116362a-3dbc-4554-ad3c-c2d37ca5dbbc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:07.853256 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6116362a-3dbc-4554-ad3c-c2d37ca5dbbc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:07.853880 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6116362a-3dbc-4554-ad3c-c2d37ca5dbbc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:07.854732 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6116362a-3dbc-4554-ad3c-c2d37ca5dbbc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:07.855523 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6116362a-3dbc-4554-ad3c-c2d37ca5dbbc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:07.856088 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6116362a-3dbc-4554-ad3c-c2d37ca5dbbc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:07.875963 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-458273ab-9ca3-4ee5-a183-e1a1d96b029f tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:07.876884 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-458273ab-9ca3-4ee5-a183-e1a1d96b029f tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:07.886827 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-458273ab-9ca3-4ee5-a183-e1a1d96b029f tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:07.890063 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-458273ab-9ca3-4ee5-a183-e1a1d96b029f tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:07.890660 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-458273ab-9ca3-4ee5-a183-e1a1d96b029f tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:07.892749 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-458273ab-9ca3-4ee5-a183-e1a1d96b029f tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:07.895143 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-458273ab-9ca3-4ee5-a183-e1a1d96b029f tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:07.896113 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-458273ab-9ca3-4ee5-a183-e1a1d96b029f tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:08.268943 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-458273ab-9ca3-4ee5-a183-e1a1d96b029f tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:08.285637 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-458273ab-9ca3-4ee5-a183-e1a1d96b029f tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.410940 Aug 05 10:27:08.285637 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 80/155] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:07 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:27:08.290312 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-a1db187c-4ec5-464d-8208-b12dee68b3f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:08.290948 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-a1db187c-4ec5-464d-8208-b12dee68b3f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:08.300909 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a1db187c-4ec5-464d-8208-b12dee68b3f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:08.301407 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a1db187c-4ec5-464d-8208-b12dee68b3f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:08.302040 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a1db187c-4ec5-464d-8208-b12dee68b3f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:08.302852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a1db187c-4ec5-464d-8208-b12dee68b3f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:08.303283 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a1db187c-4ec5-464d-8208-b12dee68b3f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:08.307280 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a1db187c-4ec5-464d-8208-b12dee68b3f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:08.356728 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6116362a-3dbc-4554-ad3c-c2d37ca5dbbc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:08.369970 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6116362a-3dbc-4554-ad3c-c2d37ca5dbbc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.526592 Aug 05 10:27:08.372195 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 76/156] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:07 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:08.386556 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-b4dffc7d-b099-4e8f-8643-e8e271ed8642 req-f7d08871-4aea-40a7-bdca-3660b2bbe4bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6b3944-32c7-4652-be72-e448219cee78", "name": "network-vif-plugged", "status": "completed", "tag": "0504379a-29d1-4c32-8abd-1c246bd31d77"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:27:08.405798 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-b4dffc7d-b099-4e8f-8643-e8e271ed8642 req-f7d08871-4aea-40a7-bdca-3660b2bbe4bd service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:08.406275 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-b4dffc7d-b099-4e8f-8643-e8e271ed8642 req-f7d08871-4aea-40a7-bdca-3660b2bbe4bd service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:08.406783 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-b4dffc7d-b099-4e8f-8643-e8e271ed8642 req-f7d08871-4aea-40a7-bdca-3660b2bbe4bd service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:08.420709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-b4dffc7d-b099-4e8f-8643-e8e271ed8642 req-f7d08871-4aea-40a7-bdca-3660b2bbe4bd service nova] Creating event network-vif-plugged:0504379a-29d1-4c32-8abd-1c246bd31d77 for instance 3d6b3944-32c7-4652-be72-e448219cee78 on hv-cinder-81558 Aug 05 10:27:08.426971 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-b4dffc7d-b099-4e8f-8643-e8e271ed8642 req-f7d08871-4aea-40a7-bdca-3660b2bbe4bd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052463 Aug 05 10:27:08.428134 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 77/157] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:27:08.436183 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d252fc22-5e1b-4768-9921-faef2e2ba6d5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:08.438032 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d252fc22-5e1b-4768-9921-faef2e2ba6d5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:08.446436 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d252fc22-5e1b-4768-9921-faef2e2ba6d5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:08.448496 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d252fc22-5e1b-4768-9921-faef2e2ba6d5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:08.448685 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d252fc22-5e1b-4768-9921-faef2e2ba6d5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:08.450002 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d252fc22-5e1b-4768-9921-faef2e2ba6d5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:08.452013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d252fc22-5e1b-4768-9921-faef2e2ba6d5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:08.452728 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d252fc22-5e1b-4768-9921-faef2e2ba6d5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:08.657890 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d252fc22-5e1b-4768-9921-faef2e2ba6d5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:08.666730 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d252fc22-5e1b-4768-9921-faef2e2ba6d5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.236961 Aug 05 10:27:08.667980 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 78/158] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:08 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:08.678948 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a1db187c-4ec5-464d-8208-b12dee68b3f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:08.688290 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a1db187c-4ec5-464d-8208-b12dee68b3f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:08.689912 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a1db187c-4ec5-464d-8208-b12dee68b3f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:08.691101 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-a1db187c-4ec5-464d-8208-b12dee68b3f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.406633 Aug 05 10:27:08.691686 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 81/159] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:08 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:08.847580 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a466480b-0215-4b89-9b8c-1b3e3ae1bce3 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:08.848195 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a466480b-0215-4b89-9b8c-1b3e3ae1bce3 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:08.854834 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a466480b-0215-4b89-9b8c-1b3e3ae1bce3 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:08.855367 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a466480b-0215-4b89-9b8c-1b3e3ae1bce3 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:08.855898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a466480b-0215-4b89-9b8c-1b3e3ae1bce3 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:08.856597 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a466480b-0215-4b89-9b8c-1b3e3ae1bce3 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:08.857123 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a466480b-0215-4b89-9b8c-1b3e3ae1bce3 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:08.857549 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a466480b-0215-4b89-9b8c-1b3e3ae1bce3 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:09.052055 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a466480b-0215-4b89-9b8c-1b3e3ae1bce3 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:09.059753 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a466480b-0215-4b89-9b8c-1b3e3ae1bce3 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.216499 Aug 05 10:27:09.060317 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 79/160] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:08 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:09.303537 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-62991a18-5415-4429-a779-f4b0ebd98db7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:09.304153 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-62991a18-5415-4429-a779-f4b0ebd98db7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:09.310082 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-62991a18-5415-4429-a779-f4b0ebd98db7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:09.310535 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-62991a18-5415-4429-a779-f4b0ebd98db7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:09.311158 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-62991a18-5415-4429-a779-f4b0ebd98db7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:09.311830 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-62991a18-5415-4429-a779-f4b0ebd98db7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:09.312267 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-62991a18-5415-4429-a779-f4b0ebd98db7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:09.312682 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-62991a18-5415-4429-a779-f4b0ebd98db7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:09.395937 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2e59ec41-3b53-4bc9-badf-5a2e6aa887e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:09.395937 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2e59ec41-3b53-4bc9-badf-5a2e6aa887e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:09.400589 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e59ec41-3b53-4bc9-badf-5a2e6aa887e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:09.401065 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e59ec41-3b53-4bc9-badf-5a2e6aa887e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:09.401489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e59ec41-3b53-4bc9-badf-5a2e6aa887e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:09.402181 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e59ec41-3b53-4bc9-badf-5a2e6aa887e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:09.402621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e59ec41-3b53-4bc9-badf-5a2e6aa887e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:09.403061 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e59ec41-3b53-4bc9-badf-5a2e6aa887e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:09.423846 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:27:09.465652 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-62991a18-5415-4429-a779-f4b0ebd98db7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:09.473851 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-62991a18-5415-4429-a779-f4b0ebd98db7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.174070 Aug 05 10:27:09.474835 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 82/161] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:09 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:09.591436 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2e59ec41-3b53-4bc9-badf-5a2e6aa887e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:09.601110 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2e59ec41-3b53-4bc9-badf-5a2e6aa887e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.211101 Aug 05 10:27:09.602293 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 80/162] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:09 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:09.690016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-641b98a3-d32b-4b13-ad4a-e88d65877d84 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:09.690727 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-641b98a3-d32b-4b13-ad4a-e88d65877d84 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:09.700835 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-641b98a3-d32b-4b13-ad4a-e88d65877d84 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:09.701324 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-641b98a3-d32b-4b13-ad4a-e88d65877d84 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:09.703442 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-641b98a3-d32b-4b13-ad4a-e88d65877d84 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:09.704165 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-641b98a3-d32b-4b13-ad4a-e88d65877d84 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:09.704623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-641b98a3-d32b-4b13-ad4a-e88d65877d84 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:09.705050 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-641b98a3-d32b-4b13-ad4a-e88d65877d84 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:09.714081 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bd30cd6f-359a-413d-aded-9aa407f2d448 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:09.714685 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bd30cd6f-359a-413d-aded-9aa407f2d448 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:09.722355 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bd30cd6f-359a-413d-aded-9aa407f2d448 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:09.722837 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bd30cd6f-359a-413d-aded-9aa407f2d448 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:09.723287 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bd30cd6f-359a-413d-aded-9aa407f2d448 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:09.723984 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bd30cd6f-359a-413d-aded-9aa407f2d448 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:09.724432 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bd30cd6f-359a-413d-aded-9aa407f2d448 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:09.724853 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bd30cd6f-359a-413d-aded-9aa407f2d448 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:09.935456 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-641b98a3-d32b-4b13-ad4a-e88d65877d84 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:09.957313 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bd30cd6f-359a-413d-aded-9aa407f2d448 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:09.969088 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bd30cd6f-359a-413d-aded-9aa407f2d448 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:09.969996 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-641b98a3-d32b-4b13-ad4a-e88d65877d84 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.284559 Aug 05 10:27:09.970752 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bd30cd6f-359a-413d-aded-9aa407f2d448 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:09.972504 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bd30cd6f-359a-413d-aded-9aa407f2d448 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.262284 Aug 05 10:27:09.973160 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 81/163] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:09 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 10:27:09.987470 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 83/164] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:09 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:10.081098 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b52b261d-d2f6-4671-882f-d4ff4ab026e4 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:10.081760 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b52b261d-d2f6-4671-882f-d4ff4ab026e4 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:10.089986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b52b261d-d2f6-4671-882f-d4ff4ab026e4 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:10.091010 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b52b261d-d2f6-4671-882f-d4ff4ab026e4 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:10.091589 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b52b261d-d2f6-4671-882f-d4ff4ab026e4 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:10.092758 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b52b261d-d2f6-4671-882f-d4ff4ab026e4 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:10.093498 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b52b261d-d2f6-4671-882f-d4ff4ab026e4 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:10.094261 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b52b261d-d2f6-4671-882f-d4ff4ab026e4 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:10.247400 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b52b261d-d2f6-4671-882f-d4ff4ab026e4 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:10.256978 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b52b261d-d2f6-4671-882f-d4ff4ab026e4 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.179768 Aug 05 10:27:10.257617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 82/165] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:10 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:10.493781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-3bdc7351-3686-47df-9168-89928cf1cbba tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:10.494515 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-3bdc7351-3686-47df-9168-89928cf1cbba tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:10.501150 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3bdc7351-3686-47df-9168-89928cf1cbba tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:10.501641 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3bdc7351-3686-47df-9168-89928cf1cbba tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:10.502134 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3bdc7351-3686-47df-9168-89928cf1cbba tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:10.502837 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3bdc7351-3686-47df-9168-89928cf1cbba tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:10.503328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3bdc7351-3686-47df-9168-89928cf1cbba tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:10.503758 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3bdc7351-3686-47df-9168-89928cf1cbba tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:10.624114 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-16026ad5-ce88-4259-84a0-543ffbd9a380 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:10.624867 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-16026ad5-ce88-4259-84a0-543ffbd9a380 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:10.639279 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-16026ad5-ce88-4259-84a0-543ffbd9a380 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:10.639990 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-16026ad5-ce88-4259-84a0-543ffbd9a380 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:10.640660 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-16026ad5-ce88-4259-84a0-543ffbd9a380 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:10.641657 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-16026ad5-ce88-4259-84a0-543ffbd9a380 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:10.642274 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-16026ad5-ce88-4259-84a0-543ffbd9a380 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:10.642886 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-16026ad5-ce88-4259-84a0-543ffbd9a380 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:10.647733 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-3bdc7351-3686-47df-9168-89928cf1cbba tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:10.656023 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-3bdc7351-3686-47df-9168-89928cf1cbba tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.166124 Aug 05 10:27:10.656593 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 84/166] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:10 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:10.818671 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-16026ad5-ce88-4259-84a0-543ffbd9a380 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:10.827174 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-16026ad5-ce88-4259-84a0-543ffbd9a380 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.207400 Aug 05 10:27:10.841332 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 83/167] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:10 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:10.998609 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-534daa6c-8639-4d00-8444-9f87d3f4175f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:10.999416 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-534daa6c-8639-4d00-8444-9f87d3f4175f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:11.006172 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-534daa6c-8639-4d00-8444-9f87d3f4175f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:11.006719 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-534daa6c-8639-4d00-8444-9f87d3f4175f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:11.008490 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-534daa6c-8639-4d00-8444-9f87d3f4175f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:11.008490 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-534daa6c-8639-4d00-8444-9f87d3f4175f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:11.008490 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-534daa6c-8639-4d00-8444-9f87d3f4175f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:11.013866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b53e292e-64dc-4cbe-a334-b02b2efe0e79 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:11.014548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b53e292e-64dc-4cbe-a334-b02b2efe0e79 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:11.017879 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-534daa6c-8639-4d00-8444-9f87d3f4175f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:11.023032 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b53e292e-64dc-4cbe-a334-b02b2efe0e79 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:11.024818 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b53e292e-64dc-4cbe-a334-b02b2efe0e79 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:11.025346 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b53e292e-64dc-4cbe-a334-b02b2efe0e79 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:11.027328 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b53e292e-64dc-4cbe-a334-b02b2efe0e79 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:11.027765 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b53e292e-64dc-4cbe-a334-b02b2efe0e79 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:11.028251 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b53e292e-64dc-4cbe-a334-b02b2efe0e79 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:11.265391 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-534daa6c-8639-4d00-8444-9f87d3f4175f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:11.265667 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b53e292e-64dc-4cbe-a334-b02b2efe0e79 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:11.276335 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b53e292e-64dc-4cbe-a334-b02b2efe0e79 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.265834 Aug 05 10:27:11.278002 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 84/168] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:11 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:11.291110 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-534daa6c-8639-4d00-8444-9f87d3f4175f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:11.291110 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-534daa6c-8639-4d00-8444-9f87d3f4175f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:11.291110 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-534daa6c-8639-4d00-8444-9f87d3f4175f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.290495 Aug 05 10:27:11.295826 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-78e4500c-1eec-47db-8c38-06a43c8cba18 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:11.296593 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-78e4500c-1eec-47db-8c38-06a43c8cba18 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:11.298537 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 85/169] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:10 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:11.302976 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-78e4500c-1eec-47db-8c38-06a43c8cba18 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:11.303446 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-78e4500c-1eec-47db-8c38-06a43c8cba18 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:11.304067 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-78e4500c-1eec-47db-8c38-06a43c8cba18 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:11.304751 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-78e4500c-1eec-47db-8c38-06a43c8cba18 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:11.305196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-78e4500c-1eec-47db-8c38-06a43c8cba18 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:11.305605 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-78e4500c-1eec-47db-8c38-06a43c8cba18 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:11.456988 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-78e4500c-1eec-47db-8c38-06a43c8cba18 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:11.465892 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-78e4500c-1eec-47db-8c38-06a43c8cba18 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.186607 Aug 05 10:27:11.466563 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 85/170] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:11 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:11.601608 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-5aee72b4-5f37-4925-ac74-e75bb3601fb4 req-60149229-4481-4587-848a-79cd735a5f1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af7c11c7-dddb-481d-9d57-af021c48e71b", "tag": "9e68983d-a83c-49ba-ac19-3c316e21a882"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:27:11.612016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-5aee72b4-5f37-4925-ac74-e75bb3601fb4 req-60149229-4481-4587-848a-79cd735a5f1b service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:11.612577 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-5aee72b4-5f37-4925-ac74-e75bb3601fb4 req-60149229-4481-4587-848a-79cd735a5f1b service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:11.613005 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-5aee72b4-5f37-4925-ac74-e75bb3601fb4 req-60149229-4481-4587-848a-79cd735a5f1b service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:11.624524 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-5aee72b4-5f37-4925-ac74-e75bb3601fb4 req-60149229-4481-4587-848a-79cd735a5f1b service nova] Creating event network-changed:9e68983d-a83c-49ba-ac19-3c316e21a882 for instance af7c11c7-dddb-481d-9d57-af021c48e71b on hv-cinder-81558 Aug 05 10:27:11.629714 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-5aee72b4-5f37-4925-ac74-e75bb3601fb4 req-60149229-4481-4587-848a-79cd735a5f1b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032242 Aug 05 10:27:11.630471 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 86/171] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:27:11.679160 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-660dbbb8-b383-4bf5-84cf-a199b710223b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:11.680025 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-660dbbb8-b383-4bf5-84cf-a199b710223b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:11.687386 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-660dbbb8-b383-4bf5-84cf-a199b710223b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:11.687858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-660dbbb8-b383-4bf5-84cf-a199b710223b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:11.688284 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-660dbbb8-b383-4bf5-84cf-a199b710223b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:11.688956 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-660dbbb8-b383-4bf5-84cf-a199b710223b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:11.689404 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-660dbbb8-b383-4bf5-84cf-a199b710223b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:11.689962 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-660dbbb8-b383-4bf5-84cf-a199b710223b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:11.819777 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-660dbbb8-b383-4bf5-84cf-a199b710223b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:11.827177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-660dbbb8-b383-4bf5-84cf-a199b710223b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.153507 Aug 05 10:27:11.827732 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 86/172] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:11 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:11.850319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f0a9b1b9-dac8-4c33-b0cb-1db890c24b59 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:11.851426 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f0a9b1b9-dac8-4c33-b0cb-1db890c24b59 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:11.858158 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f0a9b1b9-dac8-4c33-b0cb-1db890c24b59 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:11.858661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f0a9b1b9-dac8-4c33-b0cb-1db890c24b59 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:11.859123 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f0a9b1b9-dac8-4c33-b0cb-1db890c24b59 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:11.860062 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f0a9b1b9-dac8-4c33-b0cb-1db890c24b59 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:11.860547 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f0a9b1b9-dac8-4c33-b0cb-1db890c24b59 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:11.861022 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f0a9b1b9-dac8-4c33-b0cb-1db890c24b59 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:12.027409 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-f0a9b1b9-dac8-4c33-b0cb-1db890c24b59 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:12.038417 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f0a9b1b9-dac8-4c33-b0cb-1db890c24b59 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.193325 Aug 05 10:27:12.039015 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 87/173] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:11 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:27:12.104006 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-27f86195-ba3b-40d1-8ca4-a7d256be2239 req-67895e59-c2ca-40c2-aa17-d23f0cf07d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfcbf025-92b9-4b98-8819-7f9fb41dce79", "name": "network-vif-plugged", "status": "completed", "tag": "d4746dc0-741a-473e-b9a5-dd97a9ff2872"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:27:12.114635 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-27f86195-ba3b-40d1-8ca4-a7d256be2239 req-67895e59-c2ca-40c2-aa17-d23f0cf07d11 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:12.115272 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-27f86195-ba3b-40d1-8ca4-a7d256be2239 req-67895e59-c2ca-40c2-aa17-d23f0cf07d11 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:12.115722 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-27f86195-ba3b-40d1-8ca4-a7d256be2239 req-67895e59-c2ca-40c2-aa17-d23f0cf07d11 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:12.128248 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-27f86195-ba3b-40d1-8ca4-a7d256be2239 req-67895e59-c2ca-40c2-aa17-d23f0cf07d11 service nova] Creating event network-vif-plugged:d4746dc0-741a-473e-b9a5-dd97a9ff2872 for instance cfcbf025-92b9-4b98-8819-7f9fb41dce79 on hv-cinder-81558 Aug 05 10:27:12.133745 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-27f86195-ba3b-40d1-8ca4-a7d256be2239 req-67895e59-c2ca-40c2-aa17-d23f0cf07d11 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033885 Aug 05 10:27:12.134376 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 87/174] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:27:12.298875 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-6dae077a-32b1-47a2-bfa2-f8ada1a351b7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:12.300103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-6dae077a-32b1-47a2-bfa2-f8ada1a351b7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:12.307352 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6dae077a-32b1-47a2-bfa2-f8ada1a351b7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:12.307529 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6dae077a-32b1-47a2-bfa2-f8ada1a351b7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:12.307963 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6dae077a-32b1-47a2-bfa2-f8ada1a351b7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:12.308745 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6dae077a-32b1-47a2-bfa2-f8ada1a351b7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:12.309206 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6dae077a-32b1-47a2-bfa2-f8ada1a351b7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:12.309607 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6dae077a-32b1-47a2-bfa2-f8ada1a351b7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:12.310583 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4e564db2-7385-4775-b3c2-a73b8964adb2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:12.311513 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4e564db2-7385-4775-b3c2-a73b8964adb2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:12.320545 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e564db2-7385-4775-b3c2-a73b8964adb2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:12.321315 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e564db2-7385-4775-b3c2-a73b8964adb2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:12.321838 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e564db2-7385-4775-b3c2-a73b8964adb2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:12.322834 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e564db2-7385-4775-b3c2-a73b8964adb2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:12.323942 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e564db2-7385-4775-b3c2-a73b8964adb2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:12.325779 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e564db2-7385-4775-b3c2-a73b8964adb2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:12.465335 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-6dae077a-32b1-47a2-bfa2-f8ada1a351b7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:12.469924 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4e564db2-7385-4775-b3c2-a73b8964adb2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:12.470221 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=100 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:27:12.475904 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-6dae077a-32b1-47a2-bfa2-f8ada1a351b7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.180930 Aug 05 10:27:12.476138 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 88/175] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:12 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:12.486794 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4e564db2-7385-4775-b3c2-a73b8964adb2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:12.489001 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4e564db2-7385-4775-b3c2-a73b8964adb2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:12.490428 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4e564db2-7385-4775-b3c2-a73b8964adb2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.187197 Aug 05 10:27:12.499631 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-9beaa805-f142-4570-be24-450cf8cee990 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:12.499631 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-9beaa805-f142-4570-be24-450cf8cee990 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:12.500330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 88/176] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:12 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:12.513126 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9beaa805-f142-4570-be24-450cf8cee990 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:12.513676 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9beaa805-f142-4570-be24-450cf8cee990 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:12.514175 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9beaa805-f142-4570-be24-450cf8cee990 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:12.514992 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9beaa805-f142-4570-be24-450cf8cee990 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:12.515529 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9beaa805-f142-4570-be24-450cf8cee990 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:12.516214 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9beaa805-f142-4570-be24-450cf8cee990 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:12.662754 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-9beaa805-f142-4570-be24-450cf8cee990 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:12.670384 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-9beaa805-f142-4570-be24-450cf8cee990 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.181624 Aug 05 10:27:12.671004 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 89/177] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:12 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:12.849082 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-59da5564-e068-4de2-b8f2-4dd91c9f34cc tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:12.849679 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-59da5564-e068-4de2-b8f2-4dd91c9f34cc tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:12.856333 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-59da5564-e068-4de2-b8f2-4dd91c9f34cc tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:12.856828 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-59da5564-e068-4de2-b8f2-4dd91c9f34cc tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:12.857248 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-59da5564-e068-4de2-b8f2-4dd91c9f34cc tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:12.857925 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-59da5564-e068-4de2-b8f2-4dd91c9f34cc tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:12.858363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-59da5564-e068-4de2-b8f2-4dd91c9f34cc tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:12.858773 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-59da5564-e068-4de2-b8f2-4dd91c9f34cc tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:12.996467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-59da5564-e068-4de2-b8f2-4dd91c9f34cc tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:13.004330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-59da5564-e068-4de2-b8f2-4dd91c9f34cc tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.159709 Aug 05 10:27:13.004936 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 89/178] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:12 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:13.059770 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c8ed7bfa-e9f5-4928-a95f-156ec750413a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:13.060378 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c8ed7bfa-e9f5-4928-a95f-156ec750413a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:13.067490 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c8ed7bfa-e9f5-4928-a95f-156ec750413a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:13.068054 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c8ed7bfa-e9f5-4928-a95f-156ec750413a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:13.068509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c8ed7bfa-e9f5-4928-a95f-156ec750413a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:13.069193 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c8ed7bfa-e9f5-4928-a95f-156ec750413a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:13.069638 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c8ed7bfa-e9f5-4928-a95f-156ec750413a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:13.070054 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c8ed7bfa-e9f5-4928-a95f-156ec750413a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:13.211799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c8ed7bfa-e9f5-4928-a95f-156ec750413a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:13.223257 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c8ed7bfa-e9f5-4928-a95f-156ec750413a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.167355 Aug 05 10:27:13.223835 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 90/179] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:13 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:13.502598 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-37e4b897-3439-44d7-ba9a-277f80715acc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:13.503735 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-37e4b897-3439-44d7-ba9a-277f80715acc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:13.514177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37e4b897-3439-44d7-ba9a-277f80715acc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:13.514959 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37e4b897-3439-44d7-ba9a-277f80715acc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:13.515723 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37e4b897-3439-44d7-ba9a-277f80715acc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:13.516841 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37e4b897-3439-44d7-ba9a-277f80715acc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:13.517628 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37e4b897-3439-44d7-ba9a-277f80715acc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:13.518279 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37e4b897-3439-44d7-ba9a-277f80715acc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:13.518887 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-294a0371-175c-48b1-88fa-70354b8c899c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:13.519892 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-294a0371-175c-48b1-88fa-70354b8c899c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:13.526225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-294a0371-175c-48b1-88fa-70354b8c899c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:13.526702 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-294a0371-175c-48b1-88fa-70354b8c899c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:13.527169 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-294a0371-175c-48b1-88fa-70354b8c899c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:13.527853 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-294a0371-175c-48b1-88fa-70354b8c899c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:13.528329 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-294a0371-175c-48b1-88fa-70354b8c899c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:13.528748 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-294a0371-175c-48b1-88fa-70354b8c899c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:13.656021 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-37e4b897-3439-44d7-ba9a-277f80715acc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:13.659085 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-294a0371-175c-48b1-88fa-70354b8c899c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:13.664266 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-37e4b897-3439-44d7-ba9a-277f80715acc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.168113 Aug 05 10:27:13.664872 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 90/180] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:13 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:13.669585 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-294a0371-175c-48b1-88fa-70354b8c899c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:13.671192 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-294a0371-175c-48b1-88fa-70354b8c899c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:13.672291 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-294a0371-175c-48b1-88fa-70354b8c899c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.160115 Aug 05 10:27:13.672869 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 91/181] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:13 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:13.690845 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e09c4ef3-90cb-4144-9c9f-999ab02c7d41 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:13.691709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e09c4ef3-90cb-4144-9c9f-999ab02c7d41 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:13.697645 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e09c4ef3-90cb-4144-9c9f-999ab02c7d41 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:13.698122 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e09c4ef3-90cb-4144-9c9f-999ab02c7d41 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:13.698549 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e09c4ef3-90cb-4144-9c9f-999ab02c7d41 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:13.699273 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e09c4ef3-90cb-4144-9c9f-999ab02c7d41 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:13.699712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e09c4ef3-90cb-4144-9c9f-999ab02c7d41 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:13.700137 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e09c4ef3-90cb-4144-9c9f-999ab02c7d41 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:13.844512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e09c4ef3-90cb-4144-9c9f-999ab02c7d41 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:13.853393 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e09c4ef3-90cb-4144-9c9f-999ab02c7d41 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.166319 Aug 05 10:27:13.853996 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 91/182] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:13 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:14.029130 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c719257f-ac9f-4c2b-917a-e59cde089caa tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:14.030134 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c719257f-ac9f-4c2b-917a-e59cde089caa tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:14.039193 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c719257f-ac9f-4c2b-917a-e59cde089caa tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:14.039676 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c719257f-ac9f-4c2b-917a-e59cde089caa tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:14.040100 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c719257f-ac9f-4c2b-917a-e59cde089caa tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:14.040792 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c719257f-ac9f-4c2b-917a-e59cde089caa tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:14.041232 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c719257f-ac9f-4c2b-917a-e59cde089caa tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:14.041633 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c719257f-ac9f-4c2b-917a-e59cde089caa tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:14.177609 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c719257f-ac9f-4c2b-917a-e59cde089caa tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:14.185215 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c719257f-ac9f-4c2b-917a-e59cde089caa tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.162916 Aug 05 10:27:14.185773 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 92/183] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:14 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:14.254036 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0f93634d-476c-4d6d-a575-46341b98b318 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:14.255096 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0f93634d-476c-4d6d-a575-46341b98b318 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:14.265756 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f93634d-476c-4d6d-a575-46341b98b318 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:14.266533 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f93634d-476c-4d6d-a575-46341b98b318 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:14.267311 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f93634d-476c-4d6d-a575-46341b98b318 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:14.268422 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f93634d-476c-4d6d-a575-46341b98b318 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:14.269231 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f93634d-476c-4d6d-a575-46341b98b318 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:14.269990 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f93634d-476c-4d6d-a575-46341b98b318 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:14.422868 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0f93634d-476c-4d6d-a575-46341b98b318 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:14.430760 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0f93634d-476c-4d6d-a575-46341b98b318 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.183566 Aug 05 10:27:14.431373 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 92/184] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:14 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:14.687867 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c6ffb345-aa11-4b42-a3a1-5aba61b94078 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:14.688751 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c6ffb345-aa11-4b42-a3a1-5aba61b94078 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:14.696591 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2784dc72-13fa-4af7-9003-deffdf4e9bcb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:14.697102 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6ffb345-aa11-4b42-a3a1-5aba61b94078 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:14.697335 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2784dc72-13fa-4af7-9003-deffdf4e9bcb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:14.697624 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6ffb345-aa11-4b42-a3a1-5aba61b94078 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:14.698055 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6ffb345-aa11-4b42-a3a1-5aba61b94078 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:14.698746 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6ffb345-aa11-4b42-a3a1-5aba61b94078 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:14.699236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6ffb345-aa11-4b42-a3a1-5aba61b94078 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:14.699663 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6ffb345-aa11-4b42-a3a1-5aba61b94078 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:14.703670 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2784dc72-13fa-4af7-9003-deffdf4e9bcb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:14.704156 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2784dc72-13fa-4af7-9003-deffdf4e9bcb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:14.704557 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2784dc72-13fa-4af7-9003-deffdf4e9bcb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:14.705436 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2784dc72-13fa-4af7-9003-deffdf4e9bcb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:14.705887 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2784dc72-13fa-4af7-9003-deffdf4e9bcb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:14.706307 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2784dc72-13fa-4af7-9003-deffdf4e9bcb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:14.831106 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c6ffb345-aa11-4b42-a3a1-5aba61b94078 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:14.836280 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2784dc72-13fa-4af7-9003-deffdf4e9bcb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:14.839646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c6ffb345-aa11-4b42-a3a1-5aba61b94078 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.158050 Aug 05 10:27:14.840404 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 93/185] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:14 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:14.857621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2784dc72-13fa-4af7-9003-deffdf4e9bcb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:14.859399 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2784dc72-13fa-4af7-9003-deffdf4e9bcb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:14.860436 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2784dc72-13fa-4af7-9003-deffdf4e9bcb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.168488 Aug 05 10:27:14.861016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 93/186] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:14 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:14.874264 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-e12ad45c-22ce-4d61-99cc-5caeef25f2b2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:14.875107 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-e12ad45c-22ce-4d61-99cc-5caeef25f2b2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:14.881805 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e12ad45c-22ce-4d61-99cc-5caeef25f2b2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:14.882221 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e12ad45c-22ce-4d61-99cc-5caeef25f2b2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:14.882651 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e12ad45c-22ce-4d61-99cc-5caeef25f2b2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:14.883389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e12ad45c-22ce-4d61-99cc-5caeef25f2b2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:14.883840 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e12ad45c-22ce-4d61-99cc-5caeef25f2b2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:14.884254 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e12ad45c-22ce-4d61-99cc-5caeef25f2b2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:15.022030 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e12ad45c-22ce-4d61-99cc-5caeef25f2b2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:15.030295 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-e12ad45c-22ce-4d61-99cc-5caeef25f2b2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.160428 Aug 05 10:27:15.030872 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 94/187] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:14 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:15.208546 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a39cd7f9-c9eb-4df1-b4ea-2c12766a250c tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:15.209581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a39cd7f9-c9eb-4df1-b4ea-2c12766a250c tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:15.218385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a39cd7f9-c9eb-4df1-b4ea-2c12766a250c tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:15.218940 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a39cd7f9-c9eb-4df1-b4ea-2c12766a250c tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:15.219534 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a39cd7f9-c9eb-4df1-b4ea-2c12766a250c tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:15.220442 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a39cd7f9-c9eb-4df1-b4ea-2c12766a250c tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:15.221035 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a39cd7f9-c9eb-4df1-b4ea-2c12766a250c tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:15.221597 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a39cd7f9-c9eb-4df1-b4ea-2c12766a250c tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:15.361149 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a39cd7f9-c9eb-4df1-b4ea-2c12766a250c tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:15.369253 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a39cd7f9-c9eb-4df1-b4ea-2c12766a250c tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.166819 Aug 05 10:27:15.369821 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 94/188] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:15 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:15.456240 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-7f3354d1-9583-4ff2-b231-5546f94a92fb tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:15.457082 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-7f3354d1-9583-4ff2-b231-5546f94a92fb tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:15.467329 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7f3354d1-9583-4ff2-b231-5546f94a92fb tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:15.468147 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7f3354d1-9583-4ff2-b231-5546f94a92fb tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:15.468858 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7f3354d1-9583-4ff2-b231-5546f94a92fb tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:15.469980 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7f3354d1-9583-4ff2-b231-5546f94a92fb tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:15.470727 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7f3354d1-9583-4ff2-b231-5546f94a92fb tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:15.471522 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7f3354d1-9583-4ff2-b231-5546f94a92fb tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:15.611464 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-7f3354d1-9583-4ff2-b231-5546f94a92fb tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:15.619646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-7f3354d1-9583-4ff2-b231-5546f94a92fb tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.170058 Aug 05 10:27:15.620235 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 95/189] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:15 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:15.860858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1d759a64-d255-4bf9-a492-e6b3e0668762 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:15.861465 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1d759a64-d255-4bf9-a492-e6b3e0668762 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:15.867858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d759a64-d255-4bf9-a492-e6b3e0668762 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:15.868340 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d759a64-d255-4bf9-a492-e6b3e0668762 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:15.868767 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d759a64-d255-4bf9-a492-e6b3e0668762 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:15.869452 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d759a64-d255-4bf9-a492-e6b3e0668762 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:15.869901 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d759a64-d255-4bf9-a492-e6b3e0668762 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:15.870318 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d759a64-d255-4bf9-a492-e6b3e0668762 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:15.883013 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b8d490cf-12b8-40ee-bea5-cc6109a67b72 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:15.883626 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b8d490cf-12b8-40ee-bea5-cc6109a67b72 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:15.889609 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b8d490cf-12b8-40ee-bea5-cc6109a67b72 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:15.890293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b8d490cf-12b8-40ee-bea5-cc6109a67b72 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:15.890719 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b8d490cf-12b8-40ee-bea5-cc6109a67b72 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:15.891529 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b8d490cf-12b8-40ee-bea5-cc6109a67b72 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:15.891977 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b8d490cf-12b8-40ee-bea5-cc6109a67b72 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:15.892389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b8d490cf-12b8-40ee-bea5-cc6109a67b72 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:16.010978 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1d759a64-d255-4bf9-a492-e6b3e0668762 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:16.018665 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1d759a64-d255-4bf9-a492-e6b3e0668762 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.161716 Aug 05 10:27:16.019306 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 95/190] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:15 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:16.030299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b8d490cf-12b8-40ee-bea5-cc6109a67b72 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:16.039153 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b8d490cf-12b8-40ee-bea5-cc6109a67b72 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:16.040631 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b8d490cf-12b8-40ee-bea5-cc6109a67b72 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:16.041719 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b8d490cf-12b8-40ee-bea5-cc6109a67b72 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.162606 Aug 05 10:27:16.042270 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 96/191] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:15 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:16.051272 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ac844b97-8265-45dc-827d-8a869d75d933 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:16.051955 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ac844b97-8265-45dc-827d-8a869d75d933 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:16.058032 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ac844b97-8265-45dc-827d-8a869d75d933 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:16.058500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ac844b97-8265-45dc-827d-8a869d75d933 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:16.058950 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ac844b97-8265-45dc-827d-8a869d75d933 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:16.059641 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ac844b97-8265-45dc-827d-8a869d75d933 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:16.060074 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ac844b97-8265-45dc-827d-8a869d75d933 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:16.060488 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ac844b97-8265-45dc-827d-8a869d75d933 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:16.197607 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ac844b97-8265-45dc-827d-8a869d75d933 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:16.205170 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ac844b97-8265-45dc-827d-8a869d75d933 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.157811 Aug 05 10:27:16.205934 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 96/192] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:16 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:16.394412 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f3720a52-9b5f-43e6-8973-e8201cc301fb tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:16.395347 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f3720a52-9b5f-43e6-8973-e8201cc301fb tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:16.403279 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f3720a52-9b5f-43e6-8973-e8201cc301fb tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:16.403756 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f3720a52-9b5f-43e6-8973-e8201cc301fb tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:16.404199 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f3720a52-9b5f-43e6-8973-e8201cc301fb tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:16.404894 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f3720a52-9b5f-43e6-8973-e8201cc301fb tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:16.405338 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f3720a52-9b5f-43e6-8973-e8201cc301fb tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:16.405752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f3720a52-9b5f-43e6-8973-e8201cc301fb tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:16.547183 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-f3720a52-9b5f-43e6-8973-e8201cc301fb tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:16.555273 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f3720a52-9b5f-43e6-8973-e8201cc301fb tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.167971 Aug 05 10:27:16.555822 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 97/193] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:16 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:16.647369 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-540ea5e7-c5f4-4ba3-9680-3e5ae659a61c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:16.647955 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-540ea5e7-c5f4-4ba3-9680-3e5ae659a61c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:16.655080 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-540ea5e7-c5f4-4ba3-9680-3e5ae659a61c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:16.655604 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-540ea5e7-c5f4-4ba3-9680-3e5ae659a61c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:16.656074 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-540ea5e7-c5f4-4ba3-9680-3e5ae659a61c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:16.657557 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-540ea5e7-c5f4-4ba3-9680-3e5ae659a61c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:16.658052 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-540ea5e7-c5f4-4ba3-9680-3e5ae659a61c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:16.658509 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-540ea5e7-c5f4-4ba3-9680-3e5ae659a61c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:16.795352 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-540ea5e7-c5f4-4ba3-9680-3e5ae659a61c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:16.799130 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:27:16.803874 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-540ea5e7-c5f4-4ba3-9680-3e5ae659a61c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.163676 Aug 05 10:27:16.804438 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 97/194] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:16 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:17.039645 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c46cd22d-a933-4045-b203-6e8afb19ea67 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:17.040247 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c46cd22d-a933-4045-b203-6e8afb19ea67 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:17.046704 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c46cd22d-a933-4045-b203-6e8afb19ea67 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:17.047218 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c46cd22d-a933-4045-b203-6e8afb19ea67 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:17.047645 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c46cd22d-a933-4045-b203-6e8afb19ea67 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:17.048323 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c46cd22d-a933-4045-b203-6e8afb19ea67 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:17.048771 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c46cd22d-a933-4045-b203-6e8afb19ea67 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:17.049188 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c46cd22d-a933-4045-b203-6e8afb19ea67 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:17.064046 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5f08e0be-20ec-41e5-b2c6-8e968303f4b5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:17.064711 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5f08e0be-20ec-41e5-b2c6-8e968303f4b5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:17.071230 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5f08e0be-20ec-41e5-b2c6-8e968303f4b5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:17.071708 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5f08e0be-20ec-41e5-b2c6-8e968303f4b5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:17.072134 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5f08e0be-20ec-41e5-b2c6-8e968303f4b5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:17.072818 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5f08e0be-20ec-41e5-b2c6-8e968303f4b5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:17.073266 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5f08e0be-20ec-41e5-b2c6-8e968303f4b5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:17.073673 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5f08e0be-20ec-41e5-b2c6-8e968303f4b5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:17.189098 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c46cd22d-a933-4045-b203-6e8afb19ea67 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:17.197617 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c46cd22d-a933-4045-b203-6e8afb19ea67 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.162134 Aug 05 10:27:17.198656 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 98/195] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:17 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:17.226373 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-3c379534-871f-4344-a216-bd7eaa0f7c08 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:17.227142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-3c379534-871f-4344-a216-bd7eaa0f7c08 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:17.234104 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3c379534-871f-4344-a216-bd7eaa0f7c08 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:17.234831 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3c379534-871f-4344-a216-bd7eaa0f7c08 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:17.235355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3c379534-871f-4344-a216-bd7eaa0f7c08 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:17.236162 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3c379534-871f-4344-a216-bd7eaa0f7c08 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:17.236596 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3c379534-871f-4344-a216-bd7eaa0f7c08 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:17.237093 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3c379534-871f-4344-a216-bd7eaa0f7c08 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:17.239252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5f08e0be-20ec-41e5-b2c6-8e968303f4b5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:17.247912 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5f08e0be-20ec-41e5-b2c6-8e968303f4b5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:17.249454 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5f08e0be-20ec-41e5-b2c6-8e968303f4b5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:17.250555 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5f08e0be-20ec-41e5-b2c6-8e968303f4b5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.190413 Aug 05 10:27:17.251161 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 98/196] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:17 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:17.375993 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-3c379534-871f-4344-a216-bd7eaa0f7c08 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:17.387685 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-3c379534-871f-4344-a216-bd7eaa0f7c08 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.165256 Aug 05 10:27:17.388470 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 99/197] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:17 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:27:17.580009 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-695a264b-abb9-4a94-bd11-f93331239345 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:17.580992 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-695a264b-abb9-4a94-bd11-f93331239345 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:17.594653 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-695a264b-abb9-4a94-bd11-f93331239345 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:17.595606 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-695a264b-abb9-4a94-bd11-f93331239345 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:17.596517 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-695a264b-abb9-4a94-bd11-f93331239345 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:17.597769 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-695a264b-abb9-4a94-bd11-f93331239345 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:17.598647 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-695a264b-abb9-4a94-bd11-f93331239345 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:17.599634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-695a264b-abb9-4a94-bd11-f93331239345 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:17.733532 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-695a264b-abb9-4a94-bd11-f93331239345 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:17.743972 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-695a264b-abb9-4a94-bd11-f93331239345 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.170414 Aug 05 10:27:17.744541 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 99/198] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:17 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:17.827405 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-dc133620-8e72-47df-95ef-2b6bbf3cbea2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:17.828265 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-dc133620-8e72-47df-95ef-2b6bbf3cbea2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:17.836949 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dc133620-8e72-47df-95ef-2b6bbf3cbea2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:17.837365 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dc133620-8e72-47df-95ef-2b6bbf3cbea2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:17.837796 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dc133620-8e72-47df-95ef-2b6bbf3cbea2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:17.838515 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dc133620-8e72-47df-95ef-2b6bbf3cbea2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:17.838967 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dc133620-8e72-47df-95ef-2b6bbf3cbea2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:17.839411 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dc133620-8e72-47df-95ef-2b6bbf3cbea2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:17.970498 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-dc133620-8e72-47df-95ef-2b6bbf3cbea2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:17.980199 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-dc133620-8e72-47df-95ef-2b6bbf3cbea2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.158028 Aug 05 10:27:17.981087 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 100/199] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:17 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:18.222318 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1e7feb3f-25df-44ad-ab79-ad8aa938a3fc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:18.222913 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1e7feb3f-25df-44ad-ab79-ad8aa938a3fc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:18.231012 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e7feb3f-25df-44ad-ab79-ad8aa938a3fc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:18.231486 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e7feb3f-25df-44ad-ab79-ad8aa938a3fc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:18.231917 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e7feb3f-25df-44ad-ab79-ad8aa938a3fc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:18.232601 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e7feb3f-25df-44ad-ab79-ad8aa938a3fc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:18.233054 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e7feb3f-25df-44ad-ab79-ad8aa938a3fc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:18.233469 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e7feb3f-25df-44ad-ab79-ad8aa938a3fc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:18.272854 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d8e89d37-7190-4ce2-869a-40c68dc6e6f9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:18.273934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d8e89d37-7190-4ce2-869a-40c68dc6e6f9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:18.280309 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d8e89d37-7190-4ce2-869a-40c68dc6e6f9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:18.280803 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d8e89d37-7190-4ce2-869a-40c68dc6e6f9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:18.281226 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d8e89d37-7190-4ce2-869a-40c68dc6e6f9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:18.281913 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d8e89d37-7190-4ce2-869a-40c68dc6e6f9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:18.282361 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d8e89d37-7190-4ce2-869a-40c68dc6e6f9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:18.282782 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d8e89d37-7190-4ce2-869a-40c68dc6e6f9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:18.368080 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1e7feb3f-25df-44ad-ab79-ad8aa938a3fc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:18.375720 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1e7feb3f-25df-44ad-ab79-ad8aa938a3fc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.159244 Aug 05 10:27:18.376283 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 100/200] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:18 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:18.411307 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-10db8cb2-5cd4-4f63-8f43-77a0bf1113e0 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:18.412075 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-10db8cb2-5cd4-4f63-8f43-77a0bf1113e0 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:18.419326 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10db8cb2-5cd4-4f63-8f43-77a0bf1113e0 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:18.419739 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10db8cb2-5cd4-4f63-8f43-77a0bf1113e0 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:18.420176 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10db8cb2-5cd4-4f63-8f43-77a0bf1113e0 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:18.420873 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10db8cb2-5cd4-4f63-8f43-77a0bf1113e0 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:18.421324 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10db8cb2-5cd4-4f63-8f43-77a0bf1113e0 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:18.421746 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10db8cb2-5cd4-4f63-8f43-77a0bf1113e0 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:18.423104 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d8e89d37-7190-4ce2-869a-40c68dc6e6f9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:18.431116 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d8e89d37-7190-4ce2-869a-40c68dc6e6f9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:18.432608 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d8e89d37-7190-4ce2-869a-40c68dc6e6f9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:18.433700 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d8e89d37-7190-4ce2-869a-40c68dc6e6f9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.164718 Aug 05 10:27:18.434297 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 101/201] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:18 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 10:27:18.555049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-10db8cb2-5cd4-4f63-8f43-77a0bf1113e0 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:18.562755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-10db8cb2-5cd4-4f63-8f43-77a0bf1113e0 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.155673 Aug 05 10:27:18.563312 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 101/202] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:18 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:18.773703 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-174676bb-fff3-41b1-8a96-9aaa0c80d637 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:18.774760 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-174676bb-fff3-41b1-8a96-9aaa0c80d637 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:18.783939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-174676bb-fff3-41b1-8a96-9aaa0c80d637 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:18.784698 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-174676bb-fff3-41b1-8a96-9aaa0c80d637 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:18.785386 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-174676bb-fff3-41b1-8a96-9aaa0c80d637 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:18.786887 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-174676bb-fff3-41b1-8a96-9aaa0c80d637 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:18.787665 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-174676bb-fff3-41b1-8a96-9aaa0c80d637 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:18.788369 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-174676bb-fff3-41b1-8a96-9aaa0c80d637 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:18.927378 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-174676bb-fff3-41b1-8a96-9aaa0c80d637 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:18.935199 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-174676bb-fff3-41b1-8a96-9aaa0c80d637 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.172714 Aug 05 10:27:18.935771 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 102/203] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:18 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:19.001201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d2799273-b77d-4a56-bed3-7b385b1e1811 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:19.001936 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d2799273-b77d-4a56-bed3-7b385b1e1811 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:19.008161 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2799273-b77d-4a56-bed3-7b385b1e1811 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:19.008643 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2799273-b77d-4a56-bed3-7b385b1e1811 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:19.009076 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2799273-b77d-4a56-bed3-7b385b1e1811 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:19.009776 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2799273-b77d-4a56-bed3-7b385b1e1811 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:19.010226 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2799273-b77d-4a56-bed3-7b385b1e1811 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:19.010640 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d2799273-b77d-4a56-bed3-7b385b1e1811 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:19.153192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d2799273-b77d-4a56-bed3-7b385b1e1811 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:19.161285 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d2799273-b77d-4a56-bed3-7b385b1e1811 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.163584 Aug 05 10:27:19.161879 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 102/204] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:18 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:19.396679 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-037fa0a5-57b2-4ed0-b6db-a9be828d69af tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:19.397291 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-037fa0a5-57b2-4ed0-b6db-a9be828d69af tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:19.404104 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-037fa0a5-57b2-4ed0-b6db-a9be828d69af tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:19.404592 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-037fa0a5-57b2-4ed0-b6db-a9be828d69af tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:19.405026 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-037fa0a5-57b2-4ed0-b6db-a9be828d69af tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:19.405718 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-037fa0a5-57b2-4ed0-b6db-a9be828d69af tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:19.406175 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-037fa0a5-57b2-4ed0-b6db-a9be828d69af tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:19.406599 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-037fa0a5-57b2-4ed0-b6db-a9be828d69af tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:19.457329 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7549b7a2-7afe-4868-b74e-223d6f2d50cb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:19.458190 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7549b7a2-7afe-4868-b74e-223d6f2d50cb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:19.464721 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7549b7a2-7afe-4868-b74e-223d6f2d50cb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:19.465199 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7549b7a2-7afe-4868-b74e-223d6f2d50cb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:19.465633 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7549b7a2-7afe-4868-b74e-223d6f2d50cb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:19.466326 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7549b7a2-7afe-4868-b74e-223d6f2d50cb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:19.467238 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7549b7a2-7afe-4868-b74e-223d6f2d50cb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:19.467238 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7549b7a2-7afe-4868-b74e-223d6f2d50cb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:19.541283 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-037fa0a5-57b2-4ed0-b6db-a9be828d69af tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:19.549426 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-037fa0a5-57b2-4ed0-b6db-a9be828d69af tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.156656 Aug 05 10:27:19.550161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 103/205] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:19 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:19.583697 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-541d590f-1920-4679-a348-51fc6723cf17 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:19.584323 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-541d590f-1920-4679-a348-51fc6723cf17 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:19.590581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-541d590f-1920-4679-a348-51fc6723cf17 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:19.591019 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-541d590f-1920-4679-a348-51fc6723cf17 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:19.591447 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-541d590f-1920-4679-a348-51fc6723cf17 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:19.592126 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-541d590f-1920-4679-a348-51fc6723cf17 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:19.592566 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-541d590f-1920-4679-a348-51fc6723cf17 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:19.592979 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-541d590f-1920-4679-a348-51fc6723cf17 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:19.601228 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7549b7a2-7afe-4868-b74e-223d6f2d50cb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:19.609486 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7549b7a2-7afe-4868-b74e-223d6f2d50cb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:19.611085 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7549b7a2-7afe-4868-b74e-223d6f2d50cb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:19.612242 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7549b7a2-7afe-4868-b74e-223d6f2d50cb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.159176 Aug 05 10:27:19.612858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 103/206] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:19 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:19.731181 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-541d590f-1920-4679-a348-51fc6723cf17 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:19.740940 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-541d590f-1920-4679-a348-51fc6723cf17 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.160730 Aug 05 10:27:19.742001 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 104/207] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:19 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:27:19.959330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-60b9fbc4-082b-4fa7-af18-d82540edabbd tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:19.960381 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-60b9fbc4-082b-4fa7-af18-d82540edabbd tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:19.965769 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:27:19.972208 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60b9fbc4-082b-4fa7-af18-d82540edabbd tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:19.972931 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60b9fbc4-082b-4fa7-af18-d82540edabbd tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:19.973598 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60b9fbc4-082b-4fa7-af18-d82540edabbd tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:19.974638 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60b9fbc4-082b-4fa7-af18-d82540edabbd tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:19.975373 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60b9fbc4-082b-4fa7-af18-d82540edabbd tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:19.976483 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60b9fbc4-082b-4fa7-af18-d82540edabbd tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:20.122616 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-60b9fbc4-082b-4fa7-af18-d82540edabbd tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:20.130168 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-60b9fbc4-082b-4fa7-af18-d82540edabbd tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.177339 Aug 05 10:27:20.130695 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 104/208] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:19 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:20.181897 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-1c1461b7-b4e3-4dbe-bee3-9d6b1a82b877 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:20.182590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-1c1461b7-b4e3-4dbe-bee3-9d6b1a82b877 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:20.188857 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1c1461b7-b4e3-4dbe-bee3-9d6b1a82b877 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:20.189352 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1c1461b7-b4e3-4dbe-bee3-9d6b1a82b877 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:20.189780 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1c1461b7-b4e3-4dbe-bee3-9d6b1a82b877 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:20.190474 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1c1461b7-b4e3-4dbe-bee3-9d6b1a82b877 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:20.190929 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1c1461b7-b4e3-4dbe-bee3-9d6b1a82b877 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:20.191398 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1c1461b7-b4e3-4dbe-bee3-9d6b1a82b877 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:20.209745 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=100 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:27:20.324769 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-1c1461b7-b4e3-4dbe-bee3-9d6b1a82b877 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:20.332376 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-1c1461b7-b4e3-4dbe-bee3-9d6b1a82b877 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.154409 Aug 05 10:27:20.332946 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 105/209] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:20 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:20.573744 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8780a088-b713-42d5-bda3-eccc9ee4a30a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:20.574387 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8780a088-b713-42d5-bda3-eccc9ee4a30a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:20.582203 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8780a088-b713-42d5-bda3-eccc9ee4a30a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:20.582802 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8780a088-b713-42d5-bda3-eccc9ee4a30a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:20.583391 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8780a088-b713-42d5-bda3-eccc9ee4a30a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:20.584251 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8780a088-b713-42d5-bda3-eccc9ee4a30a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:20.584817 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8780a088-b713-42d5-bda3-eccc9ee4a30a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:20.585340 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8780a088-b713-42d5-bda3-eccc9ee4a30a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:20.637825 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-162b9431-c004-4cda-8e8b-779a1860c2c6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:20.638539 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-162b9431-c004-4cda-8e8b-779a1860c2c6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:20.645283 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-162b9431-c004-4cda-8e8b-779a1860c2c6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:20.645767 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-162b9431-c004-4cda-8e8b-779a1860c2c6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:20.646193 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-162b9431-c004-4cda-8e8b-779a1860c2c6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:20.646923 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-162b9431-c004-4cda-8e8b-779a1860c2c6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:20.647382 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-162b9431-c004-4cda-8e8b-779a1860c2c6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:20.647799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-162b9431-c004-4cda-8e8b-779a1860c2c6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:20.725570 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8780a088-b713-42d5-bda3-eccc9ee4a30a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:20.733406 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8780a088-b713-42d5-bda3-eccc9ee4a30a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.165697 Aug 05 10:27:20.734070 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 105/210] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:20 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:20.761977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1581cd4b-c9d7-46b5-83c9-d64a626b2ecc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:20.762574 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1581cd4b-c9d7-46b5-83c9-d64a626b2ecc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:20.768878 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1581cd4b-c9d7-46b5-83c9-d64a626b2ecc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:20.769350 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1581cd4b-c9d7-46b5-83c9-d64a626b2ecc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:20.769774 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1581cd4b-c9d7-46b5-83c9-d64a626b2ecc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:20.770452 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1581cd4b-c9d7-46b5-83c9-d64a626b2ecc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:20.770938 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1581cd4b-c9d7-46b5-83c9-d64a626b2ecc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:20.771340 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1581cd4b-c9d7-46b5-83c9-d64a626b2ecc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:20.780933 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-162b9431-c004-4cda-8e8b-779a1860c2c6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:20.789951 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-162b9431-c004-4cda-8e8b-779a1860c2c6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:20.791589 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-162b9431-c004-4cda-8e8b-779a1860c2c6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:20.792753 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-162b9431-c004-4cda-8e8b-779a1860c2c6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.160519 Aug 05 10:27:20.793383 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 106/211] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:20 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:20.907068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1581cd4b-c9d7-46b5-83c9-d64a626b2ecc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:20.915047 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1581cd4b-c9d7-46b5-83c9-d64a626b2ecc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.157119 Aug 05 10:27:20.915968 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 106/212] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:20 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:21.155504 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-3c28db88-9f6a-4b10-a92b-db120df0db7e tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:21.156387 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-3c28db88-9f6a-4b10-a92b-db120df0db7e tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:21.167878 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3c28db88-9f6a-4b10-a92b-db120df0db7e tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:21.168545 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3c28db88-9f6a-4b10-a92b-db120df0db7e tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:21.169020 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3c28db88-9f6a-4b10-a92b-db120df0db7e tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:21.169831 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3c28db88-9f6a-4b10-a92b-db120df0db7e tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:21.170807 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3c28db88-9f6a-4b10-a92b-db120df0db7e tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:21.170807 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3c28db88-9f6a-4b10-a92b-db120df0db7e tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:21.310424 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-3c28db88-9f6a-4b10-a92b-db120df0db7e tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:21.318583 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-3c28db88-9f6a-4b10-a92b-db120df0db7e tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.169931 Aug 05 10:27:21.319294 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 107/213] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:21 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:21.353513 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-45758024-0510-4e13-bf66-ec9f7f1f07ea tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:21.354126 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-45758024-0510-4e13-bf66-ec9f7f1f07ea tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:21.361085 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45758024-0510-4e13-bf66-ec9f7f1f07ea tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:21.361666 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45758024-0510-4e13-bf66-ec9f7f1f07ea tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:21.362227 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45758024-0510-4e13-bf66-ec9f7f1f07ea tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:21.363245 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45758024-0510-4e13-bf66-ec9f7f1f07ea tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:21.363893 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45758024-0510-4e13-bf66-ec9f7f1f07ea tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:21.364372 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45758024-0510-4e13-bf66-ec9f7f1f07ea tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:21.503051 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-45758024-0510-4e13-bf66-ec9f7f1f07ea tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:21.514758 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-45758024-0510-4e13-bf66-ec9f7f1f07ea tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.165294 Aug 05 10:27:21.515658 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 107/214] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:21 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:21.754858 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-eecc7b7d-79e9-48a5-9cc8-4206a80def59 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:21.755671 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-eecc7b7d-79e9-48a5-9cc8-4206a80def59 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:21.765143 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-eecc7b7d-79e9-48a5-9cc8-4206a80def59 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:21.765762 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-eecc7b7d-79e9-48a5-9cc8-4206a80def59 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:21.766192 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-eecc7b7d-79e9-48a5-9cc8-4206a80def59 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:21.767138 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-eecc7b7d-79e9-48a5-9cc8-4206a80def59 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:21.767719 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-eecc7b7d-79e9-48a5-9cc8-4206a80def59 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:21.768273 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-eecc7b7d-79e9-48a5-9cc8-4206a80def59 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:21.815206 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4a962494-8c0d-4a5e-a433-7d92b218b0a9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:21.815843 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4a962494-8c0d-4a5e-a433-7d92b218b0a9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:21.822008 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a962494-8c0d-4a5e-a433-7d92b218b0a9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:21.822481 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a962494-8c0d-4a5e-a433-7d92b218b0a9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:21.822923 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a962494-8c0d-4a5e-a433-7d92b218b0a9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:21.823630 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a962494-8c0d-4a5e-a433-7d92b218b0a9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:21.824077 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a962494-8c0d-4a5e-a433-7d92b218b0a9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:21.824491 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a962494-8c0d-4a5e-a433-7d92b218b0a9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:21.911094 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-eecc7b7d-79e9-48a5-9cc8-4206a80def59 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:21.926522 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-eecc7b7d-79e9-48a5-9cc8-4206a80def59 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.175455 Aug 05 10:27:21.928746 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 108/215] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:21 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:21.934654 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c2c1d210-8e90-456f-bc10-122cfbc41b2e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:21.936118 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c2c1d210-8e90-456f-bc10-122cfbc41b2e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:21.942247 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c2c1d210-8e90-456f-bc10-122cfbc41b2e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:21.942998 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c2c1d210-8e90-456f-bc10-122cfbc41b2e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:21.943865 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c2c1d210-8e90-456f-bc10-122cfbc41b2e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:21.944904 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c2c1d210-8e90-456f-bc10-122cfbc41b2e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:21.945538 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c2c1d210-8e90-456f-bc10-122cfbc41b2e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:21.946189 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c2c1d210-8e90-456f-bc10-122cfbc41b2e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:21.971128 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4a962494-8c0d-4a5e-a433-7d92b218b0a9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:21.980312 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4a962494-8c0d-4a5e-a433-7d92b218b0a9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:21.986256 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4a962494-8c0d-4a5e-a433-7d92b218b0a9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:21.987464 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4a962494-8c0d-4a5e-a433-7d92b218b0a9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.176321 Aug 05 10:27:21.988058 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 108/216] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:21 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 10:27:22.088168 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c2c1d210-8e90-456f-bc10-122cfbc41b2e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:22.096438 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c2c1d210-8e90-456f-bc10-122cfbc41b2e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.165480 Aug 05 10:27:22.097007 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 109/217] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:21 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:22.341449 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-199da00f-3834-4d5b-ba53-4c78a1b8c155 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:22.342052 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-199da00f-3834-4d5b-ba53-4c78a1b8c155 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:22.348423 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-199da00f-3834-4d5b-ba53-4c78a1b8c155 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:22.348905 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-199da00f-3834-4d5b-ba53-4c78a1b8c155 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:22.349335 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-199da00f-3834-4d5b-ba53-4c78a1b8c155 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:22.350030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-199da00f-3834-4d5b-ba53-4c78a1b8c155 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:22.350484 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-199da00f-3834-4d5b-ba53-4c78a1b8c155 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:22.350929 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-199da00f-3834-4d5b-ba53-4c78a1b8c155 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:22.507908 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-199da00f-3834-4d5b-ba53-4c78a1b8c155 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:22.516827 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-199da00f-3834-4d5b-ba53-4c78a1b8c155 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1314 microversion: 2.1 time: 0.179614 Aug 05 10:27:22.517381 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 109/218] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:22 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:22.539669 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-31f852d4-8fe4-44c1-9c74-749f92bde518 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:22.540686 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-31f852d4-8fe4-44c1-9c74-749f92bde518 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:22.547542 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-31f852d4-8fe4-44c1-9c74-749f92bde518 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:22.548027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-31f852d4-8fe4-44c1-9c74-749f92bde518 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:22.548454 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-31f852d4-8fe4-44c1-9c74-749f92bde518 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:22.549448 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-31f852d4-8fe4-44c1-9c74-749f92bde518 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:22.549901 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-31f852d4-8fe4-44c1-9c74-749f92bde518 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:22.550362 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-31f852d4-8fe4-44c1-9c74-749f92bde518 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:22.780379 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-31f852d4-8fe4-44c1-9c74-749f92bde518 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:22.788618 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-31f852d4-8fe4-44c1-9c74-749f92bde518 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.256658 Aug 05 10:27:22.789184 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 110/219] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:22 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:22.951336 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9b2f9664-058a-4e4d-8fae-912c745a2dc2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:22.951963 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9b2f9664-058a-4e4d-8fae-912c745a2dc2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:22.958658 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9b2f9664-058a-4e4d-8fae-912c745a2dc2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:22.959302 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9b2f9664-058a-4e4d-8fae-912c745a2dc2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:22.959850 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9b2f9664-058a-4e4d-8fae-912c745a2dc2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:22.960603 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9b2f9664-058a-4e4d-8fae-912c745a2dc2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:22.961125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9b2f9664-058a-4e4d-8fae-912c745a2dc2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:22.961595 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9b2f9664-058a-4e4d-8fae-912c745a2dc2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:23.010425 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-38a5a5b2-d2a7-4898-bbd9-8b9c6debae80 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:23.011074 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-38a5a5b2-d2a7-4898-bbd9-8b9c6debae80 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:23.017121 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-38a5a5b2-d2a7-4898-bbd9-8b9c6debae80 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:23.017599 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-38a5a5b2-d2a7-4898-bbd9-8b9c6debae80 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:23.018019 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-38a5a5b2-d2a7-4898-bbd9-8b9c6debae80 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:23.018698 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-38a5a5b2-d2a7-4898-bbd9-8b9c6debae80 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:23.019165 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-38a5a5b2-d2a7-4898-bbd9-8b9c6debae80 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:23.019576 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-38a5a5b2-d2a7-4898-bbd9-8b9c6debae80 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:23.098060 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9b2f9664-058a-4e4d-8fae-912c745a2dc2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:23.106336 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9b2f9664-058a-4e4d-8fae-912c745a2dc2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.158438 Aug 05 10:27:23.106975 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 110/220] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:22 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:23.118103 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9930a4c4-9ab7-4a07-bdee-1dc6c25855bf tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:23.119340 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9930a4c4-9ab7-4a07-bdee-1dc6c25855bf tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:23.125875 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9930a4c4-9ab7-4a07-bdee-1dc6c25855bf tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:23.126610 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9930a4c4-9ab7-4a07-bdee-1dc6c25855bf tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:23.127079 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9930a4c4-9ab7-4a07-bdee-1dc6c25855bf tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:23.128019 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9930a4c4-9ab7-4a07-bdee-1dc6c25855bf tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:23.128502 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9930a4c4-9ab7-4a07-bdee-1dc6c25855bf tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:23.128939 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9930a4c4-9ab7-4a07-bdee-1dc6c25855bf tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:23.163781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-38a5a5b2-d2a7-4898-bbd9-8b9c6debae80 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:23.173797 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-38a5a5b2-d2a7-4898-bbd9-8b9c6debae80 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:23.175403 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-38a5a5b2-d2a7-4898-bbd9-8b9c6debae80 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:23.176516 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-38a5a5b2-d2a7-4898-bbd9-8b9c6debae80 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.170693 Aug 05 10:27:23.177082 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 111/221] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:23 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 10:27:23.282478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9930a4c4-9ab7-4a07-bdee-1dc6c25855bf tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:23.292918 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9930a4c4-9ab7-4a07-bdee-1dc6c25855bf tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.179518 Aug 05 10:27:23.293492 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 111/222] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:23 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:23.542867 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-1baa2905-0a25-4ae2-b67a-bf8aa87d66e0 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:23.543434 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-1baa2905-0a25-4ae2-b67a-bf8aa87d66e0 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:23.549751 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1baa2905-0a25-4ae2-b67a-bf8aa87d66e0 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:23.550231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1baa2905-0a25-4ae2-b67a-bf8aa87d66e0 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:23.550664 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1baa2905-0a25-4ae2-b67a-bf8aa87d66e0 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:23.551379 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1baa2905-0a25-4ae2-b67a-bf8aa87d66e0 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:23.551851 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1baa2905-0a25-4ae2-b67a-bf8aa87d66e0 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:23.552271 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1baa2905-0a25-4ae2-b67a-bf8aa87d66e0 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:23.703670 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-1baa2905-0a25-4ae2-b67a-bf8aa87d66e0 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:23.720009 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-1baa2905-0a25-4ae2-b67a-bf8aa87d66e0 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1500 microversion: 2.1 time: 0.181246 Aug 05 10:27:23.720699 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 112/223] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:23 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1500 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:23.816484 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ac9499fd-aef7-4008-9ec9-1ae24738eeb2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:23.817508 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ac9499fd-aef7-4008-9ec9-1ae24738eeb2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:23.825195 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ac9499fd-aef7-4008-9ec9-1ae24738eeb2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:23.825980 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ac9499fd-aef7-4008-9ec9-1ae24738eeb2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:23.826687 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ac9499fd-aef7-4008-9ec9-1ae24738eeb2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:23.827752 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ac9499fd-aef7-4008-9ec9-1ae24738eeb2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:23.828477 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ac9499fd-aef7-4008-9ec9-1ae24738eeb2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:23.829109 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ac9499fd-aef7-4008-9ec9-1ae24738eeb2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:24.111410 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ac9499fd-aef7-4008-9ec9-1ae24738eeb2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:24.119963 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ac9499fd-aef7-4008-9ec9-1ae24738eeb2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.310264 Aug 05 10:27:24.120971 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 112/224] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:23 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:24.135259 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b9c6fbff-5374-456f-affa-f0879e114bea tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:24.135259 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b9c6fbff-5374-456f-affa-f0879e114bea tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:24.136921 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b9c6fbff-5374-456f-affa-f0879e114bea tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:24.138155 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b9c6fbff-5374-456f-affa-f0879e114bea tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:24.139268 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b9c6fbff-5374-456f-affa-f0879e114bea tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:24.140251 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b9c6fbff-5374-456f-affa-f0879e114bea tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:24.141211 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b9c6fbff-5374-456f-affa-f0879e114bea tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:24.141885 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b9c6fbff-5374-456f-affa-f0879e114bea tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:24.204046 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6806997e-95be-4a09-a9bf-86fb00308128 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:24.204654 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6806997e-95be-4a09-a9bf-86fb00308128 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:24.217923 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6806997e-95be-4a09-a9bf-86fb00308128 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:24.220405 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6806997e-95be-4a09-a9bf-86fb00308128 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:24.222078 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6806997e-95be-4a09-a9bf-86fb00308128 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:24.223109 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6806997e-95be-4a09-a9bf-86fb00308128 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:24.226262 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6806997e-95be-4a09-a9bf-86fb00308128 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:24.227332 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6806997e-95be-4a09-a9bf-86fb00308128 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:24.403884 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b9c6fbff-5374-456f-affa-f0879e114bea tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:24.414339 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b9c6fbff-5374-456f-affa-f0879e114bea tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1321 microversion: 2.1 time: 0.290525 Aug 05 10:27:24.415290 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 113/225] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:24 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:24.420171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-3d1875e3-425d-484f-be85-550246d82948 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:24.420960 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-3d1875e3-425d-484f-be85-550246d82948 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:24.427844 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3d1875e3-425d-484f-be85-550246d82948 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:24.428934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3d1875e3-425d-484f-be85-550246d82948 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:24.429572 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3d1875e3-425d-484f-be85-550246d82948 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:24.436505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3d1875e3-425d-484f-be85-550246d82948 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:24.439330 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3d1875e3-425d-484f-be85-550246d82948 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:24.439960 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3d1875e3-425d-484f-be85-550246d82948 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:24.518092 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6806997e-95be-4a09-a9bf-86fb00308128 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:24.528263 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6806997e-95be-4a09-a9bf-86fb00308128 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:24.529939 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6806997e-95be-4a09-a9bf-86fb00308128 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:24.531458 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6806997e-95be-4a09-a9bf-86fb00308128 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.336293 Aug 05 10:27:24.546665 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 113/226] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:24 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:24.667276 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-3d1875e3-425d-484f-be85-550246d82948 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:24.675372 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-3d1875e3-425d-484f-be85-550246d82948 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.258874 Aug 05 10:27:24.676479 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 114/227] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:24 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:25.142462 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5d818cf0-9ba6-4e5d-8755-e11f860462f5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:25.143106 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5d818cf0-9ba6-4e5d-8755-e11f860462f5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:25.155380 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d818cf0-9ba6-4e5d-8755-e11f860462f5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:25.156169 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d818cf0-9ba6-4e5d-8755-e11f860462f5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:25.156770 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d818cf0-9ba6-4e5d-8755-e11f860462f5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:25.158603 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d818cf0-9ba6-4e5d-8755-e11f860462f5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:25.159552 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d818cf0-9ba6-4e5d-8755-e11f860462f5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:25.160223 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d818cf0-9ba6-4e5d-8755-e11f860462f5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:25.191597 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:27:25.328611 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5d818cf0-9ba6-4e5d-8755-e11f860462f5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:25.337929 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5d818cf0-9ba6-4e5d-8755-e11f860462f5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.199258 Aug 05 10:27:25.338424 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 114/228] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:25 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:25.447241 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-bbec94da-0bd7-401f-9233-1c5159fe073e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:25.447241 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-bbec94da-0bd7-401f-9233-1c5159fe073e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:25.454650 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bbec94da-0bd7-401f-9233-1c5159fe073e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:25.455223 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bbec94da-0bd7-401f-9233-1c5159fe073e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:25.455605 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bbec94da-0bd7-401f-9233-1c5159fe073e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:25.457189 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bbec94da-0bd7-401f-9233-1c5159fe073e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:25.464379 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bbec94da-0bd7-401f-9233-1c5159fe073e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:25.464881 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bbec94da-0bd7-401f-9233-1c5159fe073e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:25.489271 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5d66bb20-434d-4e1c-99ca-4af60798243d tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58e727a1-7ae0-4f46-9f56-79ad77a38f46"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:27:25.491830 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5d66bb20-434d-4e1c-99ca-4af60798243d tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:25.499977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d66bb20-434d-4e1c-99ca-4af60798243d tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:25.502106 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d66bb20-434d-4e1c-99ca-4af60798243d tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:25.502773 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d66bb20-434d-4e1c-99ca-4af60798243d tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:25.503772 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d66bb20-434d-4e1c-99ca-4af60798243d tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:25.504451 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d66bb20-434d-4e1c-99ca-4af60798243d tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:25.505062 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d66bb20-434d-4e1c-99ca-4af60798243d tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:25.658253 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-bbec94da-0bd7-401f-9233-1c5159fe073e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:25.668846 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-bbec94da-0bd7-401f-9233-1c5159fe073e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1514 microversion: 2.1 time: 0.232595 Aug 05 10:27:25.669523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 115/229] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:25 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:25.689404 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-3629a689-3e68-4aaf-9d1f-81ff188721ff tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:25.690126 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-3629a689-3e68-4aaf-9d1f-81ff188721ff tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:25.697293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3629a689-3e68-4aaf-9d1f-81ff188721ff tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:25.697831 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3629a689-3e68-4aaf-9d1f-81ff188721ff tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:25.698386 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3629a689-3e68-4aaf-9d1f-81ff188721ff tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:25.699240 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3629a689-3e68-4aaf-9d1f-81ff188721ff tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:25.699683 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3629a689-3e68-4aaf-9d1f-81ff188721ff tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:25.700243 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3629a689-3e68-4aaf-9d1f-81ff188721ff tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:25.877974 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-3629a689-3e68-4aaf-9d1f-81ff188721ff tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:25.886693 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-3629a689-3e68-4aaf-9d1f-81ff188721ff tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:25.888480 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-3629a689-3e68-4aaf-9d1f-81ff188721ff tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:25.889697 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-3629a689-3e68-4aaf-9d1f-81ff188721ff tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.219214 Aug 05 10:27:25.891076 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 116/230] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:25 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:25.896211 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-15ec1253-609a-4ff2-acca-7677de93b100 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:27:25.898594 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-15ec1253-609a-4ff2-acca-7677de93b100 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:25.904961 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-15ec1253-609a-4ff2-acca-7677de93b100 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:25.905493 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-15ec1253-609a-4ff2-acca-7677de93b100 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:25.906123 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-15ec1253-609a-4ff2-acca-7677de93b100 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:25.906996 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-15ec1253-609a-4ff2-acca-7677de93b100 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:25.907583 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-15ec1253-609a-4ff2-acca-7677de93b100 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:25.908133 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-15ec1253-609a-4ff2-acca-7677de93b100 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:25.971922 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.objects.instance [None req-15ec1253-609a-4ff2-acca-7677de93b100 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lazy-loading 'flavor' on Instance uuid 3d6b3944-32c7-4652-be72-e448219cee78 {{(pid=117831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:27:26.173313 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-15ec1253-609a-4ff2-acca-7677de93b100 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "POST /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78/action" status: 200 len: 32 microversion: 2.1 time: 0.280729 Aug 05 10:27:26.178126 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 117/231] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 10:27:25 2022] POST /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78/action => generated 32 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 10:27:26.185319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-377b91dc-b5bb-47a8-8b1e-d6054951f8b4 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:26.186076 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-377b91dc-b5bb-47a8-8b1e-d6054951f8b4 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:26.193359 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-377b91dc-b5bb-47a8-8b1e-d6054951f8b4 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:26.193922 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-377b91dc-b5bb-47a8-8b1e-d6054951f8b4 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:26.194410 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-377b91dc-b5bb-47a8-8b1e-d6054951f8b4 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:26.195301 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-377b91dc-b5bb-47a8-8b1e-d6054951f8b4 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:26.195743 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-377b91dc-b5bb-47a8-8b1e-d6054951f8b4 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:26.196411 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-377b91dc-b5bb-47a8-8b1e-d6054951f8b4 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:26.757271 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-377b91dc-b5bb-47a8-8b1e-d6054951f8b4 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:26.781928 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-377b91dc-b5bb-47a8-8b1e-d6054951f8b4 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.602212 Aug 05 10:27:26.783758 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 118/232] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:26 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:26.788791 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b36b774c-97fe-43ed-be94-1968ea566fbe tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:26.789485 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b36b774c-97fe-43ed-be94-1968ea566fbe tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:26.796494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b36b774c-97fe-43ed-be94-1968ea566fbe tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:26.797482 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b36b774c-97fe-43ed-be94-1968ea566fbe tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:26.798036 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b36b774c-97fe-43ed-be94-1968ea566fbe tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:26.799059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b36b774c-97fe-43ed-be94-1968ea566fbe tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:26.799743 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b36b774c-97fe-43ed-be94-1968ea566fbe tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:26.800387 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b36b774c-97fe-43ed-be94-1968ea566fbe tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:27.022127 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b36b774c-97fe-43ed-be94-1968ea566fbe tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:27.042294 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b36b774c-97fe-43ed-be94-1968ea566fbe tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.256559 Aug 05 10:27:27.043961 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 119/233] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:26 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:27.054390 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-1ab44ce3-312a-4fae-90f4-51fa97f777a5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:27.056044 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-1ab44ce3-312a-4fae-90f4-51fa97f777a5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:27.070423 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1ab44ce3-312a-4fae-90f4-51fa97f777a5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:27.071536 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1ab44ce3-312a-4fae-90f4-51fa97f777a5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:27.072481 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1ab44ce3-312a-4fae-90f4-51fa97f777a5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:27.073304 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1ab44ce3-312a-4fae-90f4-51fa97f777a5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:27.073949 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1ab44ce3-312a-4fae-90f4-51fa97f777a5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:27.074598 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1ab44ce3-312a-4fae-90f4-51fa97f777a5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:27.088643 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:27:27.376560 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-1ab44ce3-312a-4fae-90f4-51fa97f777a5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:27.385665 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-1ab44ce3-312a-4fae-90f4-51fa97f777a5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1366 microversion: 2.1 time: 0.339642 Aug 05 10:27:27.396908 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 120/234] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:27 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:27.406592 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-e87cf402-e2b3-44a6-94c7-ed39f409adc7 req-96229523-641b-4da9-afa6-eee69ac30b1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cef9d70-01bd-4d04-829d-2495d889f34a", "name": "network-vif-plugged", "status": "completed", "tag": "7375bfe2-586c-4ea8-9eaf-e4a40b7c68d9"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:27:27.430780 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-e87cf402-e2b3-44a6-94c7-ed39f409adc7 req-96229523-641b-4da9-afa6-eee69ac30b1b service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:27.433157 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-e87cf402-e2b3-44a6-94c7-ed39f409adc7 req-96229523-641b-4da9-afa6-eee69ac30b1b service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:27.434571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-e87cf402-e2b3-44a6-94c7-ed39f409adc7 req-96229523-641b-4da9-afa6-eee69ac30b1b service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:27.449011 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-e87cf402-e2b3-44a6-94c7-ed39f409adc7 req-96229523-641b-4da9-afa6-eee69ac30b1b service nova] Creating event network-vif-plugged:7375bfe2-586c-4ea8-9eaf-e4a40b7c68d9 for instance 6cef9d70-01bd-4d04-829d-2495d889f34a on hv-cinder-81558 Aug 05 10:27:27.454989 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-e87cf402-e2b3-44a6-94c7-ed39f409adc7 req-96229523-641b-4da9-afa6-eee69ac30b1b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056770 Aug 05 10:27:27.456115 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 121/235] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:27:27.464862 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ddae8e39-bc13-43af-a5d0-ff3bfa3189d7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:27.465895 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-ddae8e39-bc13-43af-a5d0-ff3bfa3189d7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:27.474122 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ddae8e39-bc13-43af-a5d0-ff3bfa3189d7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:27.474785 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ddae8e39-bc13-43af-a5d0-ff3bfa3189d7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:27.475428 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ddae8e39-bc13-43af-a5d0-ff3bfa3189d7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:27.476641 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ddae8e39-bc13-43af-a5d0-ff3bfa3189d7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:27.477227 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ddae8e39-bc13-43af-a5d0-ff3bfa3189d7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:27.478323 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ddae8e39-bc13-43af-a5d0-ff3bfa3189d7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:27.636226 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ddae8e39-bc13-43af-a5d0-ff3bfa3189d7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:27.647431 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ddae8e39-bc13-43af-a5d0-ff3bfa3189d7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:27.649761 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ddae8e39-bc13-43af-a5d0-ff3bfa3189d7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:27.651463 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ddae8e39-bc13-43af-a5d0-ff3bfa3189d7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.194046 Aug 05 10:27:27.653208 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 122/236] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:27 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:27.809129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-174123bb-8f96-4572-9c86-f8fd2475b226 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:27.810427 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-174123bb-8f96-4572-9c86-f8fd2475b226 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:27.817763 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-174123bb-8f96-4572-9c86-f8fd2475b226 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:27.818941 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-174123bb-8f96-4572-9c86-f8fd2475b226 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:27.819603 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-174123bb-8f96-4572-9c86-f8fd2475b226 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:27.820634 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-174123bb-8f96-4572-9c86-f8fd2475b226 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:27.821459 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-174123bb-8f96-4572-9c86-f8fd2475b226 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:27.822170 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-174123bb-8f96-4572-9c86-f8fd2475b226 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:28.167958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5d66bb20-434d-4e1c-99ca-4af60798243d tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "POST /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.682633 Aug 05 10:27:28.177402 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 115/237] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 10:27:25 2022] POST /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111/os-volume_attachments => generated 194 bytes in 2694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:27:28.186503 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b856edd4-17e0-45e3-a51f-e0c70fdab222 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:28.187641 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b856edd4-17e0-45e3-a51f-e0c70fdab222 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:28.198026 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b856edd4-17e0-45e3-a51f-e0c70fdab222 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:28.199147 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b856edd4-17e0-45e3-a51f-e0c70fdab222 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:28.199742 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b856edd4-17e0-45e3-a51f-e0c70fdab222 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:28.200616 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b856edd4-17e0-45e3-a51f-e0c70fdab222 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:28.201223 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b856edd4-17e0-45e3-a51f-e0c70fdab222 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:28.201834 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b856edd4-17e0-45e3-a51f-e0c70fdab222 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:28.231712 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-174123bb-8f96-4572-9c86-f8fd2475b226 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:28.241172 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-174123bb-8f96-4572-9c86-f8fd2475b226 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.437472 Aug 05 10:27:28.242346 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 123/238] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:27 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:27:28.415211 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-bdf891ba-530a-474e-81d2-0b6b33aceee3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:28.416185 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-bdf891ba-530a-474e-81d2-0b6b33aceee3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:28.423968 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=100 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:27:28.425707 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bdf891ba-530a-474e-81d2-0b6b33aceee3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:28.426338 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bdf891ba-530a-474e-81d2-0b6b33aceee3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:28.426979 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bdf891ba-530a-474e-81d2-0b6b33aceee3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:28.427933 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bdf891ba-530a-474e-81d2-0b6b33aceee3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:28.428383 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bdf891ba-530a-474e-81d2-0b6b33aceee3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:28.428801 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bdf891ba-530a-474e-81d2-0b6b33aceee3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:28.540866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b856edd4-17e0-45e3-a51f-e0c70fdab222 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:28.554418 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b856edd4-17e0-45e3-a51f-e0c70fdab222 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.374355 Aug 05 10:27:28.557517 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 116/239] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:28 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:28.659464 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-bdf891ba-530a-474e-81d2-0b6b33aceee3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:28.668925 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-bdf891ba-530a-474e-81d2-0b6b33aceee3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1557 microversion: 2.1 time: 0.261853 Aug 05 10:27:28.669508 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 124/240] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:28 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1557 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:28.679108 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ae4fb4e5-2d7c-4bff-a4ad-cf3ead142453 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:28.679108 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ae4fb4e5-2d7c-4bff-a4ad-cf3ead142453 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:28.706217 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ae4fb4e5-2d7c-4bff-a4ad-cf3ead142453 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:28.708516 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ae4fb4e5-2d7c-4bff-a4ad-cf3ead142453 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:28.709869 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ae4fb4e5-2d7c-4bff-a4ad-cf3ead142453 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:28.711671 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ae4fb4e5-2d7c-4bff-a4ad-cf3ead142453 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:28.713429 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ae4fb4e5-2d7c-4bff-a4ad-cf3ead142453 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:28.713929 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ae4fb4e5-2d7c-4bff-a4ad-cf3ead142453 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:28.715733 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f8d0208d-d966-4131-afea-94309f51dfee tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:28.716428 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f8d0208d-d966-4131-afea-94309f51dfee tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:28.732236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f8d0208d-d966-4131-afea-94309f51dfee tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:28.733033 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f8d0208d-d966-4131-afea-94309f51dfee tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:28.735928 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f8d0208d-d966-4131-afea-94309f51dfee tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:28.737102 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f8d0208d-d966-4131-afea-94309f51dfee tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:28.737753 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f8d0208d-d966-4131-afea-94309f51dfee tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:28.739676 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f8d0208d-d966-4131-afea-94309f51dfee tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:29.101461 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f8d0208d-d966-4131-afea-94309f51dfee tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.403193 Aug 05 10:27:29.107702 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 125/241] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 5 10:27:28 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79/os-interface => generated 285 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:27:29.266169 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-a406d2ec-8d9a-4bb0-9502-767e3b7c361b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:29.266781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-a406d2ec-8d9a-4bb0-9502-767e3b7c361b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:29.276226 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a406d2ec-8d9a-4bb0-9502-767e3b7c361b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:29.278894 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a406d2ec-8d9a-4bb0-9502-767e3b7c361b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:29.279381 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a406d2ec-8d9a-4bb0-9502-767e3b7c361b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:29.283492 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a406d2ec-8d9a-4bb0-9502-767e3b7c361b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:29.283971 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a406d2ec-8d9a-4bb0-9502-767e3b7c361b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:29.285185 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a406d2ec-8d9a-4bb0-9502-767e3b7c361b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:29.691801 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a406d2ec-8d9a-4bb0-9502-767e3b7c361b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:29.704706 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-a406d2ec-8d9a-4bb0-9502-767e3b7c361b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.443222 Aug 05 10:27:29.719464 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 126/242] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:29 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:27:29.724563 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-02246410-2abd-49fe-bccf-662ff265732a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:29.725174 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-02246410-2abd-49fe-bccf-662ff265732a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:29.732720 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02246410-2abd-49fe-bccf-662ff265732a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:29.733814 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02246410-2abd-49fe-bccf-662ff265732a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:29.734254 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02246410-2abd-49fe-bccf-662ff265732a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:29.735155 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02246410-2abd-49fe-bccf-662ff265732a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:29.735760 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02246410-2abd-49fe-bccf-662ff265732a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:29.736333 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02246410-2abd-49fe-bccf-662ff265732a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:29.765822 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ae4fb4e5-2d7c-4bff-a4ad-cf3ead142453 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:29.779716 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ae4fb4e5-2d7c-4bff-a4ad-cf3ead142453 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:29.781738 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ae4fb4e5-2d7c-4bff-a4ad-cf3ead142453 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:29.783394 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ae4fb4e5-2d7c-4bff-a4ad-cf3ead142453 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 1.110543 Aug 05 10:27:29.784537 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 117/243] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:28 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:29.931384 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-02246410-2abd-49fe-bccf-662ff265732a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:29.939591 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-02246410-2abd-49fe-bccf-662ff265732a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.218719 Aug 05 10:27:29.940562 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 127/244] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:29 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:30.727146 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8512a7bb-87d3-48d0-b8be-40682111e8c2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:30.728062 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8512a7bb-87d3-48d0-b8be-40682111e8c2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:30.739654 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8512a7bb-87d3-48d0-b8be-40682111e8c2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:30.740204 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8512a7bb-87d3-48d0-b8be-40682111e8c2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:30.740655 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8512a7bb-87d3-48d0-b8be-40682111e8c2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:30.743862 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8512a7bb-87d3-48d0-b8be-40682111e8c2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:30.744288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8512a7bb-87d3-48d0-b8be-40682111e8c2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:30.744731 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8512a7bb-87d3-48d0-b8be-40682111e8c2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:30.806276 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-52004c3a-6076-4e7a-b80e-f078ae88857a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:30.808575 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-52004c3a-6076-4e7a-b80e-f078ae88857a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:30.816741 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-52004c3a-6076-4e7a-b80e-f078ae88857a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:30.817559 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-52004c3a-6076-4e7a-b80e-f078ae88857a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:30.818672 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-52004c3a-6076-4e7a-b80e-f078ae88857a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:30.820363 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-52004c3a-6076-4e7a-b80e-f078ae88857a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:30.821361 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-52004c3a-6076-4e7a-b80e-f078ae88857a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:30.823177 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-52004c3a-6076-4e7a-b80e-f078ae88857a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:31.228501 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8512a7bb-87d3-48d0-b8be-40682111e8c2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:31.242644 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8512a7bb-87d3-48d0-b8be-40682111e8c2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1362 microversion: 2.1 time: 0.518864 Aug 05 10:27:31.247576 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 118/245] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:30 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1362 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:31.261735 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-abeb4c2d-5b70-411c-8562-223314ae9b9d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:31.261735 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-abeb4c2d-5b70-411c-8562-223314ae9b9d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:31.273972 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-abeb4c2d-5b70-411c-8562-223314ae9b9d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:31.274537 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-abeb4c2d-5b70-411c-8562-223314ae9b9d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:31.275000 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-abeb4c2d-5b70-411c-8562-223314ae9b9d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:31.277511 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-abeb4c2d-5b70-411c-8562-223314ae9b9d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:31.278063 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-abeb4c2d-5b70-411c-8562-223314ae9b9d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:31.278489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-abeb4c2d-5b70-411c-8562-223314ae9b9d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:31.553842 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-52004c3a-6076-4e7a-b80e-f078ae88857a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:31.567119 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-52004c3a-6076-4e7a-b80e-f078ae88857a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:31.570445 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-52004c3a-6076-4e7a-b80e-f078ae88857a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:31.571955 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-52004c3a-6076-4e7a-b80e-f078ae88857a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.769730 Aug 05 10:27:31.572831 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 128/246] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:30 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:31.629158 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-abeb4c2d-5b70-411c-8562-223314ae9b9d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:31.642681 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-abeb4c2d-5b70-411c-8562-223314ae9b9d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.393231 Aug 05 10:27:31.643594 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 119/247] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:31 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:32.018327 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-e6188c1a-2264-4e0b-8bce-c2eb40cd6282 req-2441bd19-2fbf-40fe-9d1f-35c9f44a7b35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfcbf025-92b9-4b98-8819-7f9fb41dce79", "tag": "d4746dc0-741a-473e-b9a5-dd97a9ff2872"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:27:32.032617 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-e6188c1a-2264-4e0b-8bce-c2eb40cd6282 req-2441bd19-2fbf-40fe-9d1f-35c9f44a7b35 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:32.033339 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-e6188c1a-2264-4e0b-8bce-c2eb40cd6282 req-2441bd19-2fbf-40fe-9d1f-35c9f44a7b35 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:32.033910 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-e6188c1a-2264-4e0b-8bce-c2eb40cd6282 req-2441bd19-2fbf-40fe-9d1f-35c9f44a7b35 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:32.050975 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-e6188c1a-2264-4e0b-8bce-c2eb40cd6282 req-2441bd19-2fbf-40fe-9d1f-35c9f44a7b35 service nova] Creating event network-changed:d4746dc0-741a-473e-b9a5-dd97a9ff2872 for instance cfcbf025-92b9-4b98-8819-7f9fb41dce79 on hv-cinder-81558 Aug 05 10:27:32.062784 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-e6188c1a-2264-4e0b-8bce-c2eb40cd6282 req-2441bd19-2fbf-40fe-9d1f-35c9f44a7b35 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046335 Aug 05 10:27:32.064970 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 129/248] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:27:32.280545 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6c327460-ef0f-416b-b161-4e4e8cf2fb67 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:32.281148 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6c327460-ef0f-416b-b161-4e4e8cf2fb67 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:32.300973 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6c327460-ef0f-416b-b161-4e4e8cf2fb67 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:32.301461 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6c327460-ef0f-416b-b161-4e4e8cf2fb67 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:32.301896 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6c327460-ef0f-416b-b161-4e4e8cf2fb67 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:32.302596 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6c327460-ef0f-416b-b161-4e4e8cf2fb67 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:32.303067 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6c327460-ef0f-416b-b161-4e4e8cf2fb67 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:32.303481 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6c327460-ef0f-416b-b161-4e4e8cf2fb67 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:32.526841 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6c327460-ef0f-416b-b161-4e4e8cf2fb67 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:32.542484 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6c327460-ef0f-416b-b161-4e4e8cf2fb67 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1547 microversion: 2.1 time: 0.265541 Aug 05 10:27:32.543780 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 120/249] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:32 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1547 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:32.572150 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-4fae2d6c-deb2-4461-902a-cc7f6e77b4c2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:32.572740 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-4fae2d6c-deb2-4461-902a-cc7f6e77b4c2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:32.583570 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4fae2d6c-deb2-4461-902a-cc7f6e77b4c2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:32.584060 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4fae2d6c-deb2-4461-902a-cc7f6e77b4c2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:32.584491 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4fae2d6c-deb2-4461-902a-cc7f6e77b4c2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:32.585203 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4fae2d6c-deb2-4461-902a-cc7f6e77b4c2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:32.585647 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4fae2d6c-deb2-4461-902a-cc7f6e77b4c2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:32.586057 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4fae2d6c-deb2-4461-902a-cc7f6e77b4c2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:32.596151 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c19a8280-3757-4f6f-825f-294701c35f02 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:32.596752 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c19a8280-3757-4f6f-825f-294701c35f02 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:32.607663 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c19a8280-3757-4f6f-825f-294701c35f02 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:32.611615 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c19a8280-3757-4f6f-825f-294701c35f02 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:32.612102 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c19a8280-3757-4f6f-825f-294701c35f02 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:32.612825 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c19a8280-3757-4f6f-825f-294701c35f02 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:32.613273 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c19a8280-3757-4f6f-825f-294701c35f02 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:32.613683 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c19a8280-3757-4f6f-825f-294701c35f02 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:32.853165 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c19a8280-3757-4f6f-825f-294701c35f02 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:32.862851 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c19a8280-3757-4f6f-825f-294701c35f02 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:32.870631 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c19a8280-3757-4f6f-825f-294701c35f02 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:32.872176 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c19a8280-3757-4f6f-825f-294701c35f02 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.280532 Aug 05 10:27:32.872840 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 121/250] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:32 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:32.892845 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-38d3bc55-8eb2-4205-a6ca-aa4fa89df1da tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:32.893759 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-38d3bc55-8eb2-4205-a6ca-aa4fa89df1da tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:32.905265 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-38d3bc55-8eb2-4205-a6ca-aa4fa89df1da tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:32.906033 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-38d3bc55-8eb2-4205-a6ca-aa4fa89df1da tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:32.906618 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-38d3bc55-8eb2-4205-a6ca-aa4fa89df1da tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:32.907605 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-38d3bc55-8eb2-4205-a6ca-aa4fa89df1da tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:32.908483 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-38d3bc55-8eb2-4205-a6ca-aa4fa89df1da tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:32.909173 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-38d3bc55-8eb2-4205-a6ca-aa4fa89df1da tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:32.941427 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-4fae2d6c-deb2-4461-902a-cc7f6e77b4c2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.379210 Aug 05 10:27:32.942212 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 130/251] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 5 10:27:32 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a/os-interface => generated 284 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:27:33.396320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-38d3bc55-8eb2-4205-a6ca-aa4fa89df1da tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:33.405905 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-38d3bc55-8eb2-4205-a6ca-aa4fa89df1da tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.531851 Aug 05 10:27:33.406723 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 122/252] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:32 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:33.896960 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-cf8cce08-33e1-4561-b529-e5d670f0872d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:33.897563 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-cf8cce08-33e1-4561-b529-e5d670f0872d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:33.911485 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cf8cce08-33e1-4561-b529-e5d670f0872d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:33.912086 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cf8cce08-33e1-4561-b529-e5d670f0872d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:33.912534 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cf8cce08-33e1-4561-b529-e5d670f0872d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:33.917534 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cf8cce08-33e1-4561-b529-e5d670f0872d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:33.918946 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cf8cce08-33e1-4561-b529-e5d670f0872d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:33.920514 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cf8cce08-33e1-4561-b529-e5d670f0872d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:34.326561 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-cf8cce08-33e1-4561-b529-e5d670f0872d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:34.336683 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-cf8cce08-33e1-4561-b529-e5d670f0872d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:34.341545 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-cf8cce08-33e1-4561-b529-e5d670f0872d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:34.347063 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-cf8cce08-33e1-4561-b529-e5d670f0872d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.452457 Aug 05 10:27:34.348215 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 131/253] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:33 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:34.428486 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-67df10b9-8280-40c8-9071-4bac42b72cb2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:34.429105 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-67df10b9-8280-40c8-9071-4bac42b72cb2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:34.438477 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-67df10b9-8280-40c8-9071-4bac42b72cb2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:34.443219 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-67df10b9-8280-40c8-9071-4bac42b72cb2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:34.443710 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-67df10b9-8280-40c8-9071-4bac42b72cb2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:34.444557 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-67df10b9-8280-40c8-9071-4bac42b72cb2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:34.445028 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-67df10b9-8280-40c8-9071-4bac42b72cb2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:34.446681 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-67df10b9-8280-40c8-9071-4bac42b72cb2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:34.759965 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-67df10b9-8280-40c8-9071-4bac42b72cb2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:34.770579 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-67df10b9-8280-40c8-9071-4bac42b72cb2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.346627 Aug 05 10:27:34.785038 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 123/254] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:34 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:34.827306 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-f27a5bd5-dcd7-47f9-9fec-afec8686cdc8 req-9268f3e5-9e0e-4023-8b89-60bdab5c1c5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cef9d70-01bd-4d04-829d-2495d889f34a", "tag": "7375bfe2-586c-4ea8-9eaf-e4a40b7c68d9"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:27:34.841862 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-f27a5bd5-dcd7-47f9-9fec-afec8686cdc8 req-9268f3e5-9e0e-4023-8b89-60bdab5c1c5b service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:34.842956 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-f27a5bd5-dcd7-47f9-9fec-afec8686cdc8 req-9268f3e5-9e0e-4023-8b89-60bdab5c1c5b service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:34.843454 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-f27a5bd5-dcd7-47f9-9fec-afec8686cdc8 req-9268f3e5-9e0e-4023-8b89-60bdab5c1c5b service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:34.856562 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-f27a5bd5-dcd7-47f9-9fec-afec8686cdc8 req-9268f3e5-9e0e-4023-8b89-60bdab5c1c5b service nova] Creating event network-changed:7375bfe2-586c-4ea8-9eaf-e4a40b7c68d9 for instance 6cef9d70-01bd-4d04-829d-2495d889f34a on hv-cinder-81558 Aug 05 10:27:34.861654 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-f27a5bd5-dcd7-47f9-9fec-afec8686cdc8 req-9268f3e5-9e0e-4023-8b89-60bdab5c1c5b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039021 Aug 05 10:27:34.862499 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 132/255] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:27:35.373642 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-55d7dd5f-2602-4a09-aa22-5e555afeef1b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:35.374350 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-55d7dd5f-2602-4a09-aa22-5e555afeef1b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:35.388791 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-55d7dd5f-2602-4a09-aa22-5e555afeef1b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:35.390679 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-55d7dd5f-2602-4a09-aa22-5e555afeef1b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:35.391446 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-55d7dd5f-2602-4a09-aa22-5e555afeef1b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:35.394080 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-55d7dd5f-2602-4a09-aa22-5e555afeef1b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:35.395347 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-55d7dd5f-2602-4a09-aa22-5e555afeef1b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:35.395944 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-55d7dd5f-2602-4a09-aa22-5e555afeef1b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:35.582436 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-55d7dd5f-2602-4a09-aa22-5e555afeef1b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:35.596294 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-55d7dd5f-2602-4a09-aa22-5e555afeef1b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:35.598723 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-55d7dd5f-2602-4a09-aa22-5e555afeef1b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:35.600269 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-55d7dd5f-2602-4a09-aa22-5e555afeef1b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.233035 Aug 05 10:27:35.601395 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 124/256] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:35 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:35.795324 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-afa7907a-9ba4-4a56-b2e3-2f8efba7d9c1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:35.796902 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-afa7907a-9ba4-4a56-b2e3-2f8efba7d9c1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:35.810768 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-afa7907a-9ba4-4a56-b2e3-2f8efba7d9c1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:35.818549 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-afa7907a-9ba4-4a56-b2e3-2f8efba7d9c1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:35.820530 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-afa7907a-9ba4-4a56-b2e3-2f8efba7d9c1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:35.821700 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-afa7907a-9ba4-4a56-b2e3-2f8efba7d9c1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:35.822309 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-afa7907a-9ba4-4a56-b2e3-2f8efba7d9c1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:35.823126 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-afa7907a-9ba4-4a56-b2e3-2f8efba7d9c1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:36.227883 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-afa7907a-9ba4-4a56-b2e3-2f8efba7d9c1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:36.242886 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-afa7907a-9ba4-4a56-b2e3-2f8efba7d9c1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.453492 Aug 05 10:27:36.243502 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 133/257] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:35 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:36.630277 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-35459dc4-eaa3-4d0e-b183-43ac924650c3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:36.631952 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-35459dc4-eaa3-4d0e-b183-43ac924650c3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:36.643417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-35459dc4-eaa3-4d0e-b183-43ac924650c3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:36.647019 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-35459dc4-eaa3-4d0e-b183-43ac924650c3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:36.651745 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-35459dc4-eaa3-4d0e-b183-43ac924650c3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:36.654926 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-35459dc4-eaa3-4d0e-b183-43ac924650c3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:36.655657 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-35459dc4-eaa3-4d0e-b183-43ac924650c3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:36.656262 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-35459dc4-eaa3-4d0e-b183-43ac924650c3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:37.283355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d9069b61-b828-4632-bfbf-12cd90e90258 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:37.284353 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d9069b61-b828-4632-bfbf-12cd90e90258 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:37.315493 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d9069b61-b828-4632-bfbf-12cd90e90258 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:37.317555 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d9069b61-b828-4632-bfbf-12cd90e90258 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:37.318823 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d9069b61-b828-4632-bfbf-12cd90e90258 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:37.320838 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d9069b61-b828-4632-bfbf-12cd90e90258 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:37.321520 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d9069b61-b828-4632-bfbf-12cd90e90258 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:37.322176 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d9069b61-b828-4632-bfbf-12cd90e90258 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:37.391454 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-35459dc4-eaa3-4d0e-b183-43ac924650c3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:37.401747 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-35459dc4-eaa3-4d0e-b183-43ac924650c3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:37.404157 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-35459dc4-eaa3-4d0e-b183-43ac924650c3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:37.405934 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-35459dc4-eaa3-4d0e-b183-43ac924650c3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.780587 Aug 05 10:27:37.407034 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 125/258] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:36 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:37.710789 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d9069b61-b828-4632-bfbf-12cd90e90258 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:37.722374 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d9069b61-b828-4632-bfbf-12cd90e90258 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.458321 Aug 05 10:27:37.734412 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 134/259] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:37 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:38.431368 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bed65dc5-2e58-4771-8305-4d3837dcef71 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:38.431991 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bed65dc5-2e58-4771-8305-4d3837dcef71 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:38.439794 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bed65dc5-2e58-4771-8305-4d3837dcef71 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:38.440280 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bed65dc5-2e58-4771-8305-4d3837dcef71 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:38.440706 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bed65dc5-2e58-4771-8305-4d3837dcef71 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:38.441411 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bed65dc5-2e58-4771-8305-4d3837dcef71 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:38.441863 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bed65dc5-2e58-4771-8305-4d3837dcef71 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:38.442278 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bed65dc5-2e58-4771-8305-4d3837dcef71 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:38.717220 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bed65dc5-2e58-4771-8305-4d3837dcef71 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:38.726341 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bed65dc5-2e58-4771-8305-4d3837dcef71 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:38.729559 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bed65dc5-2e58-4771-8305-4d3837dcef71 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:38.730669 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bed65dc5-2e58-4771-8305-4d3837dcef71 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.304776 Aug 05 10:27:38.746799 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 126/260] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:38 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 10:27:38.751911 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-32f4baf2-dfd8-4e29-a42c-e48a8116cdc7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:38.752864 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-32f4baf2-dfd8-4e29-a42c-e48a8116cdc7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:38.761465 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-32f4baf2-dfd8-4e29-a42c-e48a8116cdc7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:38.762368 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-32f4baf2-dfd8-4e29-a42c-e48a8116cdc7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:38.763307 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-32f4baf2-dfd8-4e29-a42c-e48a8116cdc7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:38.764257 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-32f4baf2-dfd8-4e29-a42c-e48a8116cdc7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:38.764899 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-32f4baf2-dfd8-4e29-a42c-e48a8116cdc7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:38.765476 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-32f4baf2-dfd8-4e29-a42c-e48a8116cdc7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:39.022015 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-32f4baf2-dfd8-4e29-a42c-e48a8116cdc7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:39.034521 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-32f4baf2-dfd8-4e29-a42c-e48a8116cdc7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.288758 Aug 05 10:27:39.036327 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 135/261] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:38 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:39.292751 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1f57adf4-d6a4-4e1a-a427-c5e4f03abcc9 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:39.293248 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1f57adf4-d6a4-4e1a-a427-c5e4f03abcc9 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:39.300215 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f57adf4-d6a4-4e1a-a427-c5e4f03abcc9 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:39.300974 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f57adf4-d6a4-4e1a-a427-c5e4f03abcc9 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:39.301419 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f57adf4-d6a4-4e1a-a427-c5e4f03abcc9 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:39.302130 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f57adf4-d6a4-4e1a-a427-c5e4f03abcc9 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:39.302590 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f57adf4-d6a4-4e1a-a427-c5e4f03abcc9 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:39.303044 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f57adf4-d6a4-4e1a-a427-c5e4f03abcc9 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:39.338530 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1f57adf4-d6a4-4e1a-a427-c5e4f03abcc9 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 10:27:39.465872 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1f57adf4-d6a4-4e1a-a427-c5e4f03abcc9 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 204 len: 0 microversion: 2.1 time: 0.164481 Aug 05 10:27:39.466858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 127/262] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:27:39 2022] DELETE /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:27:39.476865 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-1feab069-b726-4c10-9de6-d134ac88cd41 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:39.478847 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-1feab069-b726-4c10-9de6-d134ac88cd41 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:39.487561 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1feab069-b726-4c10-9de6-d134ac88cd41 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:39.488560 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1feab069-b726-4c10-9de6-d134ac88cd41 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:39.489172 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1feab069-b726-4c10-9de6-d134ac88cd41 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:39.490357 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1feab069-b726-4c10-9de6-d134ac88cd41 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:39.491713 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1feab069-b726-4c10-9de6-d134ac88cd41 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:39.492352 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1feab069-b726-4c10-9de6-d134ac88cd41 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:39.775622 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d6e7cc28-221c-4e7f-b681-e36b2d568a76 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:39.776327 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d6e7cc28-221c-4e7f-b681-e36b2d568a76 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:39.793081 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6e7cc28-221c-4e7f-b681-e36b2d568a76 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:39.797525 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-1feab069-b726-4c10-9de6-d134ac88cd41 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:39.807452 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6e7cc28-221c-4e7f-b681-e36b2d568a76 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:39.809061 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6e7cc28-221c-4e7f-b681-e36b2d568a76 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:39.812052 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6e7cc28-221c-4e7f-b681-e36b2d568a76 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:39.813538 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6e7cc28-221c-4e7f-b681-e36b2d568a76 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:39.813962 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-1feab069-b726-4c10-9de6-d134ac88cd41 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1552 microversion: 2.1 time: 0.341175 Aug 05 10:27:39.814531 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6e7cc28-221c-4e7f-b681-e36b2d568a76 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:39.830756 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 136/263] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:39 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1552 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:39.835251 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:27:40.058795 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-a4c48698-75ec-4891-92c9-450ed85a1781 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:40.059737 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-a4c48698-75ec-4891-92c9-450ed85a1781 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:40.081349 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a4c48698-75ec-4891-92c9-450ed85a1781 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:40.082782 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a4c48698-75ec-4891-92c9-450ed85a1781 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:40.084316 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a4c48698-75ec-4891-92c9-450ed85a1781 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:40.086724 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a4c48698-75ec-4891-92c9-450ed85a1781 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:40.087737 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a4c48698-75ec-4891-92c9-450ed85a1781 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:40.090300 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a4c48698-75ec-4891-92c9-450ed85a1781 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:40.297457 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d6e7cc28-221c-4e7f-b681-e36b2d568a76 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:40.315581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d6e7cc28-221c-4e7f-b681-e36b2d568a76 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:40.320815 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d6e7cc28-221c-4e7f-b681-e36b2d568a76 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:40.322560 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d6e7cc28-221c-4e7f-b681-e36b2d568a76 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.563440 Aug 05 10:27:40.325644 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 128/264] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:39 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 10:27:40.375549 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-34aec499-438f-45b0-ae8b-d758b24ec410 req-d96a1d50-5a12-4ad1-931e-859142eda1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7c11c7-dddb-481d-9d57-af021c48e71b", "name": "network-vif-plugged", "status": "completed", "tag": "9e68983d-a83c-49ba-ac19-3c316e21a882"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:27:40.386770 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-34aec499-438f-45b0-ae8b-d758b24ec410 req-d96a1d50-5a12-4ad1-931e-859142eda1e4 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:40.387294 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-34aec499-438f-45b0-ae8b-d758b24ec410 req-d96a1d50-5a12-4ad1-931e-859142eda1e4 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:40.387719 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-34aec499-438f-45b0-ae8b-d758b24ec410 req-d96a1d50-5a12-4ad1-931e-859142eda1e4 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:40.409345 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-34aec499-438f-45b0-ae8b-d758b24ec410 req-d96a1d50-5a12-4ad1-931e-859142eda1e4 service nova] Creating event network-vif-plugged:9e68983d-a83c-49ba-ac19-3c316e21a882 for instance af7c11c7-dddb-481d-9d57-af021c48e71b on hv-cinder-81558 Aug 05 10:27:40.428742 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-34aec499-438f-45b0-ae8b-d758b24ec410 req-d96a1d50-5a12-4ad1-931e-859142eda1e4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056790 Aug 05 10:27:40.430524 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 129/265] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:27:40.442171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a4c48698-75ec-4891-92c9-450ed85a1781 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:40.450478 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-a4c48698-75ec-4891-92c9-450ed85a1781 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.397275 Aug 05 10:27:40.451365 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 137/266] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:40 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:27:40.837255 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-af6edfad-b8c1-4264-a79b-a71cf324815b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:40.838923 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-af6edfad-b8c1-4264-a79b-a71cf324815b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:40.846415 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-af6edfad-b8c1-4264-a79b-a71cf324815b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:40.848772 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-af6edfad-b8c1-4264-a79b-a71cf324815b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:40.854814 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-af6edfad-b8c1-4264-a79b-a71cf324815b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:40.855832 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-af6edfad-b8c1-4264-a79b-a71cf324815b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:40.856505 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-af6edfad-b8c1-4264-a79b-a71cf324815b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:40.856990 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-af6edfad-b8c1-4264-a79b-a71cf324815b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:41.128691 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-af6edfad-b8c1-4264-a79b-a71cf324815b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:41.138153 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-af6edfad-b8c1-4264-a79b-a71cf324815b tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1552 microversion: 2.1 time: 0.305448 Aug 05 10:27:41.142350 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 130/267] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:40 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1552 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:41.353097 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-03292d64-90a0-458a-85ef-785743d36432 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:41.354536 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-03292d64-90a0-458a-85ef-785743d36432 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:41.366861 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-03292d64-90a0-458a-85ef-785743d36432 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:41.368011 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-03292d64-90a0-458a-85ef-785743d36432 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:41.369125 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-03292d64-90a0-458a-85ef-785743d36432 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:41.372126 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-03292d64-90a0-458a-85ef-785743d36432 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:41.372777 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-03292d64-90a0-458a-85ef-785743d36432 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:41.374422 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-03292d64-90a0-458a-85ef-785743d36432 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:41.480365 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0896b440-30e7-41c1-ac32-9781b4aa806c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:41.481304 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0896b440-30e7-41c1-ac32-9781b4aa806c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:41.491802 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0896b440-30e7-41c1-ac32-9781b4aa806c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:41.492678 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0896b440-30e7-41c1-ac32-9781b4aa806c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:41.493219 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0896b440-30e7-41c1-ac32-9781b4aa806c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:41.494044 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0896b440-30e7-41c1-ac32-9781b4aa806c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:41.494610 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0896b440-30e7-41c1-ac32-9781b4aa806c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:41.495793 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0896b440-30e7-41c1-ac32-9781b4aa806c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:41.598735 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-03292d64-90a0-458a-85ef-785743d36432 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:41.610610 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-03292d64-90a0-458a-85ef-785743d36432 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:41.612267 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-03292d64-90a0-458a-85ef-785743d36432 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:41.613510 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-03292d64-90a0-458a-85ef-785743d36432 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.266227 Aug 05 10:27:41.614172 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 138/268] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:41 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:41.883773 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0896b440-30e7-41c1-ac32-9781b4aa806c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:41.892976 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0896b440-30e7-41c1-ac32-9781b4aa806c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.424004 Aug 05 10:27:41.903968 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 131/269] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:41 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:27:42.171902 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-74453321-30c0-42e2-97a0-19b5eb5b342c tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:42.172652 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-74453321-30c0-42e2-97a0-19b5eb5b342c tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:42.178675 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-74453321-30c0-42e2-97a0-19b5eb5b342c tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:42.179207 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-74453321-30c0-42e2-97a0-19b5eb5b342c tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:42.179644 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-74453321-30c0-42e2-97a0-19b5eb5b342c tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:42.180372 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-74453321-30c0-42e2-97a0-19b5eb5b342c tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:42.180821 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-74453321-30c0-42e2-97a0-19b5eb5b342c tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:42.181240 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-74453321-30c0-42e2-97a0-19b5eb5b342c tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:42.200236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=100 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:27:42.321144 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-74453321-30c0-42e2-97a0-19b5eb5b342c tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:42.330184 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-74453321-30c0-42e2-97a0-19b5eb5b342c tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1552 microversion: 2.1 time: 0.162153 Aug 05 10:27:42.330807 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 139/270] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:42 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1552 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:42.637592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6d93360c-5983-4bb0-87fc-5628a1f14c78 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:42.638431 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6d93360c-5983-4bb0-87fc-5628a1f14c78 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:42.649688 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d93360c-5983-4bb0-87fc-5628a1f14c78 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:42.650266 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d93360c-5983-4bb0-87fc-5628a1f14c78 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:42.650770 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d93360c-5983-4bb0-87fc-5628a1f14c78 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:42.651571 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d93360c-5983-4bb0-87fc-5628a1f14c78 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:42.652108 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d93360c-5983-4bb0-87fc-5628a1f14c78 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:42.652529 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d93360c-5983-4bb0-87fc-5628a1f14c78 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:42.792163 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6d93360c-5983-4bb0-87fc-5628a1f14c78 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:42.800502 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6d93360c-5983-4bb0-87fc-5628a1f14c78 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:42.802031 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6d93360c-5983-4bb0-87fc-5628a1f14c78 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:42.803181 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6d93360c-5983-4bb0-87fc-5628a1f14c78 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.170174 Aug 05 10:27:42.803816 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 132/271] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:42 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:42.919098 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-7d175251-694e-4790-922a-77c5f2c7c79d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:42.919751 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-7d175251-694e-4790-922a-77c5f2c7c79d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:42.928900 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7d175251-694e-4790-922a-77c5f2c7c79d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:42.929392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7d175251-694e-4790-922a-77c5f2c7c79d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:42.929800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7d175251-694e-4790-922a-77c5f2c7c79d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:42.930506 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7d175251-694e-4790-922a-77c5f2c7c79d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:42.931386 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7d175251-694e-4790-922a-77c5f2c7c79d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:42.931682 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7d175251-694e-4790-922a-77c5f2c7c79d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:43.106501 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-7d175251-694e-4790-922a-77c5f2c7c79d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:43.115655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-7d175251-694e-4790-922a-77c5f2c7c79d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.200672 Aug 05 10:27:43.116342 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 140/272] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:42 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:43.351639 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a63dbbe6-a694-4062-a2bf-9f18c59d08d5 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:43.353096 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a63dbbe6-a694-4062-a2bf-9f18c59d08d5 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:43.364247 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a63dbbe6-a694-4062-a2bf-9f18c59d08d5 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:43.364958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a63dbbe6-a694-4062-a2bf-9f18c59d08d5 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:43.365525 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a63dbbe6-a694-4062-a2bf-9f18c59d08d5 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:43.366621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a63dbbe6-a694-4062-a2bf-9f18c59d08d5 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:43.367235 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a63dbbe6-a694-4062-a2bf-9f18c59d08d5 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:43.368215 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a63dbbe6-a694-4062-a2bf-9f18c59d08d5 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:43.543500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a63dbbe6-a694-4062-a2bf-9f18c59d08d5 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:43.554765 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a63dbbe6-a694-4062-a2bf-9f18c59d08d5 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1552 microversion: 2.1 time: 0.207136 Aug 05 10:27:43.556396 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 133/273] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:43 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1552 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:43.825846 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-7f82b28a-5abf-402d-8d4a-e7071ecc73ac tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:43.826782 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-7f82b28a-5abf-402d-8d4a-e7071ecc73ac tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:43.835088 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7f82b28a-5abf-402d-8d4a-e7071ecc73ac tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:43.835598 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7f82b28a-5abf-402d-8d4a-e7071ecc73ac tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:43.836034 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7f82b28a-5abf-402d-8d4a-e7071ecc73ac tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:43.836775 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7f82b28a-5abf-402d-8d4a-e7071ecc73ac tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:43.837233 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7f82b28a-5abf-402d-8d4a-e7071ecc73ac tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:43.837656 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7f82b28a-5abf-402d-8d4a-e7071ecc73ac tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:43.992265 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-7f82b28a-5abf-402d-8d4a-e7071ecc73ac tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:44.001240 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-7f82b28a-5abf-402d-8d4a-e7071ecc73ac tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:44.002726 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-7f82b28a-5abf-402d-8d4a-e7071ecc73ac tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:44.004177 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-7f82b28a-5abf-402d-8d4a-e7071ecc73ac tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.182256 Aug 05 10:27:44.004900 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 141/274] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:43 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:44.136818 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d4ba85ee-0878-43c8-a249-0ab1fdc3721e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:44.137530 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d4ba85ee-0878-43c8-a249-0ab1fdc3721e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:44.144162 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d4ba85ee-0878-43c8-a249-0ab1fdc3721e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:44.144727 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d4ba85ee-0878-43c8-a249-0ab1fdc3721e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:44.145226 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d4ba85ee-0878-43c8-a249-0ab1fdc3721e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:44.146116 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d4ba85ee-0878-43c8-a249-0ab1fdc3721e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:44.146643 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d4ba85ee-0878-43c8-a249-0ab1fdc3721e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:44.147142 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d4ba85ee-0878-43c8-a249-0ab1fdc3721e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:44.308859 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d4ba85ee-0878-43c8-a249-0ab1fdc3721e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:44.320484 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d4ba85ee-0878-43c8-a249-0ab1fdc3721e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.187806 Aug 05 10:27:44.322061 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 134/275] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:44 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:44.575786 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-a04c3db0-3b2b-4e2d-a8b2-251bc942a277 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:44.576661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-a04c3db0-3b2b-4e2d-a8b2-251bc942a277 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:44.582989 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a04c3db0-3b2b-4e2d-a8b2-251bc942a277 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:44.583688 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a04c3db0-3b2b-4e2d-a8b2-251bc942a277 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:44.584276 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a04c3db0-3b2b-4e2d-a8b2-251bc942a277 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:44.585291 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a04c3db0-3b2b-4e2d-a8b2-251bc942a277 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:44.585897 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a04c3db0-3b2b-4e2d-a8b2-251bc942a277 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:44.586395 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a04c3db0-3b2b-4e2d-a8b2-251bc942a277 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:44.773528 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a04c3db0-3b2b-4e2d-a8b2-251bc942a277 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:44.782487 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-a04c3db0-3b2b-4e2d-a8b2-251bc942a277 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1552 microversion: 2.1 time: 0.210762 Aug 05 10:27:44.783320 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 142/276] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:44 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1552 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:45.028818 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e14c0be2-1ee2-45ce-9e53-eebfcce1cdf1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:45.030295 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e14c0be2-1ee2-45ce-9e53-eebfcce1cdf1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:45.038398 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e14c0be2-1ee2-45ce-9e53-eebfcce1cdf1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:45.038880 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e14c0be2-1ee2-45ce-9e53-eebfcce1cdf1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:45.039549 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e14c0be2-1ee2-45ce-9e53-eebfcce1cdf1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:45.040613 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e14c0be2-1ee2-45ce-9e53-eebfcce1cdf1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:45.041240 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e14c0be2-1ee2-45ce-9e53-eebfcce1cdf1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:45.041801 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e14c0be2-1ee2-45ce-9e53-eebfcce1cdf1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:45.204420 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e14c0be2-1ee2-45ce-9e53-eebfcce1cdf1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:45.213245 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e14c0be2-1ee2-45ce-9e53-eebfcce1cdf1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:45.215109 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e14c0be2-1ee2-45ce-9e53-eebfcce1cdf1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:45.221449 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e14c0be2-1ee2-45ce-9e53-eebfcce1cdf1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.196844 Aug 05 10:27:45.232361 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 135/277] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:45 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:45.342617 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-19016e0c-5b79-44e7-8580-45dd46e7a618 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:45.343265 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-19016e0c-5b79-44e7-8580-45dd46e7a618 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:45.349604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-19016e0c-5b79-44e7-8580-45dd46e7a618 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:45.350082 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-19016e0c-5b79-44e7-8580-45dd46e7a618 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:45.350531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-19016e0c-5b79-44e7-8580-45dd46e7a618 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:45.351248 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-19016e0c-5b79-44e7-8580-45dd46e7a618 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:45.351727 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-19016e0c-5b79-44e7-8580-45dd46e7a618 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:45.352213 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-19016e0c-5b79-44e7-8580-45dd46e7a618 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:45.536934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-19016e0c-5b79-44e7-8580-45dd46e7a618 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:45.545007 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-19016e0c-5b79-44e7-8580-45dd46e7a618 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.206860 Aug 05 10:27:45.545574 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 143/278] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:45 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:45.807739 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0d43dae9-e768-40aa-8af3-5dd928c862a8 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:45.808518 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0d43dae9-e768-40aa-8af3-5dd928c862a8 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:45.815152 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d43dae9-e768-40aa-8af3-5dd928c862a8 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:45.815932 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d43dae9-e768-40aa-8af3-5dd928c862a8 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:45.816652 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d43dae9-e768-40aa-8af3-5dd928c862a8 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:45.817366 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d43dae9-e768-40aa-8af3-5dd928c862a8 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:45.817992 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d43dae9-e768-40aa-8af3-5dd928c862a8 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:45.818703 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d43dae9-e768-40aa-8af3-5dd928c862a8 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:45.989610 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0d43dae9-e768-40aa-8af3-5dd928c862a8 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:45.999139 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0d43dae9-e768-40aa-8af3-5dd928c862a8 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1552 microversion: 2.1 time: 0.195685 Aug 05 10:27:45.999811 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 136/279] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:45 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1552 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:46.243697 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d7807633-30bf-4590-9287-ef2c76e995f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:46.244571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d7807633-30bf-4590-9287-ef2c76e995f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:46.253442 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d7807633-30bf-4590-9287-ef2c76e995f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:46.254273 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d7807633-30bf-4590-9287-ef2c76e995f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:46.254922 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d7807633-30bf-4590-9287-ef2c76e995f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:46.256013 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d7807633-30bf-4590-9287-ef2c76e995f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:46.256641 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d7807633-30bf-4590-9287-ef2c76e995f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:46.257258 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d7807633-30bf-4590-9287-ef2c76e995f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:46.414037 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d7807633-30bf-4590-9287-ef2c76e995f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:46.423478 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d7807633-30bf-4590-9287-ef2c76e995f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:46.425358 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d7807633-30bf-4590-9287-ef2c76e995f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:46.426706 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d7807633-30bf-4590-9287-ef2c76e995f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.187192 Aug 05 10:27:46.441527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 144/280] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:46 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:46.567385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-551794d7-ddef-4621-b601-c31e27a80963 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:46.568766 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-551794d7-ddef-4621-b601-c31e27a80963 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:46.575845 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-551794d7-ddef-4621-b601-c31e27a80963 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:46.576327 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-551794d7-ddef-4621-b601-c31e27a80963 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:46.576751 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-551794d7-ddef-4621-b601-c31e27a80963 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:46.577447 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-551794d7-ddef-4621-b601-c31e27a80963 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:46.587340 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-551794d7-ddef-4621-b601-c31e27a80963 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:46.588075 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-551794d7-ddef-4621-b601-c31e27a80963 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:46.786933 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-551794d7-ddef-4621-b601-c31e27a80963 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:46.796746 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-551794d7-ddef-4621-b601-c31e27a80963 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.234212 Aug 05 10:27:46.797888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 137/281] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:46 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:47.020738 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-7308b1a0-2fa4-4fdc-a03b-e373a38b1420 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:47.021586 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-7308b1a0-2fa4-4fdc-a03b-e373a38b1420 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:47.028732 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7308b1a0-2fa4-4fdc-a03b-e373a38b1420 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:47.032978 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7308b1a0-2fa4-4fdc-a03b-e373a38b1420 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:47.034261 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7308b1a0-2fa4-4fdc-a03b-e373a38b1420 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:47.036912 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7308b1a0-2fa4-4fdc-a03b-e373a38b1420 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:47.037451 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7308b1a0-2fa4-4fdc-a03b-e373a38b1420 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:47.037890 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7308b1a0-2fa4-4fdc-a03b-e373a38b1420 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:47.269016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-7308b1a0-2fa4-4fdc-a03b-e373a38b1420 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:47.291483 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-7308b1a0-2fa4-4fdc-a03b-e373a38b1420 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1552 microversion: 2.1 time: 0.275666 Aug 05 10:27:47.292442 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 145/282] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:47 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1552 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:47.449067 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cc2ef0f5-e262-4418-9ea9-e1720b3f4cc9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:47.449676 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cc2ef0f5-e262-4418-9ea9-e1720b3f4cc9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:47.464449 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc2ef0f5-e262-4418-9ea9-e1720b3f4cc9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:47.464942 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc2ef0f5-e262-4418-9ea9-e1720b3f4cc9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:47.465375 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc2ef0f5-e262-4418-9ea9-e1720b3f4cc9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:47.466082 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc2ef0f5-e262-4418-9ea9-e1720b3f4cc9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:47.466535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc2ef0f5-e262-4418-9ea9-e1720b3f4cc9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:47.470687 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc2ef0f5-e262-4418-9ea9-e1720b3f4cc9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:47.707613 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cc2ef0f5-e262-4418-9ea9-e1720b3f4cc9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:47.722622 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cc2ef0f5-e262-4418-9ea9-e1720b3f4cc9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:47.724777 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cc2ef0f5-e262-4418-9ea9-e1720b3f4cc9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:47.726257 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cc2ef0f5-e262-4418-9ea9-e1720b3f4cc9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1407 microversion: 2.20 time: 0.281249 Aug 05 10:27:47.744518 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 138/283] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:47 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1407 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:47.825043 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-bcac0ecd-64b5-4723-b993-6e5c7e3b3d31 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:47.825921 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-bcac0ecd-64b5-4723-b993-6e5c7e3b3d31 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:47.841269 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bcac0ecd-64b5-4723-b993-6e5c7e3b3d31 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:47.842126 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bcac0ecd-64b5-4723-b993-6e5c7e3b3d31 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:47.842728 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bcac0ecd-64b5-4723-b993-6e5c7e3b3d31 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:47.848629 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bcac0ecd-64b5-4723-b993-6e5c7e3b3d31 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:47.849277 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bcac0ecd-64b5-4723-b993-6e5c7e3b3d31 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:47.851401 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bcac0ecd-64b5-4723-b993-6e5c7e3b3d31 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:48.138083 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-bcac0ecd-64b5-4723-b993-6e5c7e3b3d31 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:48.154503 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-bcac0ecd-64b5-4723-b993-6e5c7e3b3d31 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.336565 Aug 05 10:27:48.157969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 146/284] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:47 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:48.320376 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1bc09c2b-d1c9-4f88-94c2-59c8e2a725e5 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:48.321500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1bc09c2b-d1c9-4f88-94c2-59c8e2a725e5 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:48.336347 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1bc09c2b-d1c9-4f88-94c2-59c8e2a725e5 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:48.338175 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1bc09c2b-d1c9-4f88-94c2-59c8e2a725e5 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:48.339548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1bc09c2b-d1c9-4f88-94c2-59c8e2a725e5 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:48.340408 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1bc09c2b-d1c9-4f88-94c2-59c8e2a725e5 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:48.342149 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1bc09c2b-d1c9-4f88-94c2-59c8e2a725e5 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:48.344911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1bc09c2b-d1c9-4f88-94c2-59c8e2a725e5 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:48.428900 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-2f1b2e11-a2b6-4f83-9825-4dfff9f1663c req-5409714c-5aa2-48ef-888a-1b4bcdeacdab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7ae11ba-1225-48ce-b816-2e84d1778111", "name": "network-vif-deleted", "tag": "b0d6ae53-174d-4155-9329-092d0984bc0d"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:27:48.474196 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-2f1b2e11-a2b6-4f83-9825-4dfff9f1663c req-5409714c-5aa2-48ef-888a-1b4bcdeacdab service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:48.474688 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-2f1b2e11-a2b6-4f83-9825-4dfff9f1663c req-5409714c-5aa2-48ef-888a-1b4bcdeacdab service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:48.475166 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-2f1b2e11-a2b6-4f83-9825-4dfff9f1663c req-5409714c-5aa2-48ef-888a-1b4bcdeacdab service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:48.523783 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-2f1b2e11-a2b6-4f83-9825-4dfff9f1663c req-5409714c-5aa2-48ef-888a-1b4bcdeacdab service nova] Creating event network-vif-deleted:b0d6ae53-174d-4155-9329-092d0984bc0d for instance a7ae11ba-1225-48ce-b816-2e84d1778111 on hv-cinder-81558 Aug 05 10:27:48.536563 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-2f1b2e11-a2b6-4f83-9825-4dfff9f1663c req-5409714c-5aa2-48ef-888a-1b4bcdeacdab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111239 Aug 05 10:27:48.537929 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 147/285] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:27:48.538177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1bc09c2b-d1c9-4f88-94c2-59c8e2a725e5 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:48.554048 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1bc09c2b-d1c9-4f88-94c2-59c8e2a725e5 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1510 microversion: 2.1 time: 0.237128 Aug 05 10:27:48.563386 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 139/286] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:48 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1510 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:48.752964 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ca3b261a-6212-4ee1-991e-dda0e43cd54a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:48.754089 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-ca3b261a-6212-4ee1-991e-dda0e43cd54a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:48.764342 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ca3b261a-6212-4ee1-991e-dda0e43cd54a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:48.765092 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ca3b261a-6212-4ee1-991e-dda0e43cd54a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:48.765691 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ca3b261a-6212-4ee1-991e-dda0e43cd54a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:48.767502 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ca3b261a-6212-4ee1-991e-dda0e43cd54a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:48.768156 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ca3b261a-6212-4ee1-991e-dda0e43cd54a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:48.768675 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ca3b261a-6212-4ee1-991e-dda0e43cd54a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:48.961986 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ca3b261a-6212-4ee1-991e-dda0e43cd54a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:48.975328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ca3b261a-6212-4ee1-991e-dda0e43cd54a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:48.979213 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ca3b261a-6212-4ee1-991e-dda0e43cd54a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:48.980986 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ca3b261a-6212-4ee1-991e-dda0e43cd54a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1599 microversion: 2.20 time: 0.233793 Aug 05 10:27:48.987315 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 148/287] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:27:48 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1599 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:27:49.013465 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8fc97e5f-ffb4-4a21-a164-fc3f7663c37f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:49.015185 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8fc97e5f-ffb4-4a21-a164-fc3f7663c37f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:49.037883 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8fc97e5f-ffb4-4a21-a164-fc3f7663c37f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:49.042454 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8fc97e5f-ffb4-4a21-a164-fc3f7663c37f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:49.043066 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8fc97e5f-ffb4-4a21-a164-fc3f7663c37f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:49.044134 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8fc97e5f-ffb4-4a21-a164-fc3f7663c37f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:49.044844 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8fc97e5f-ffb4-4a21-a164-fc3f7663c37f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:49.045363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8fc97e5f-ffb4-4a21-a164-fc3f7663c37f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:49.192465 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-5644e242-8e14-4d88-a261-4bec9f7ebce4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:49.193756 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-5644e242-8e14-4d88-a261-4bec9f7ebce4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:49.217919 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8fc97e5f-ffb4-4a21-a164-fc3f7663c37f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.211452 Aug 05 10:27:49.218147 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5644e242-8e14-4d88-a261-4bec9f7ebce4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:49.218503 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 140/288] 10.222.0.40 () {60 vars in 1316 bytes} [Fri Aug 5 10:27:49 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b/os-interface => generated 284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 10:27:49.220832 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5644e242-8e14-4d88-a261-4bec9f7ebce4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:49.222768 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5644e242-8e14-4d88-a261-4bec9f7ebce4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:49.223971 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5644e242-8e14-4d88-a261-4bec9f7ebce4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:49.224637 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5644e242-8e14-4d88-a261-4bec9f7ebce4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:49.225245 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5644e242-8e14-4d88-a261-4bec9f7ebce4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:49.575023 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2e6ad377-7c02-40f6-b9fe-2da849e59050 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:49.575639 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2e6ad377-7c02-40f6-b9fe-2da849e59050 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:49.584040 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e6ad377-7c02-40f6-b9fe-2da849e59050 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:49.589838 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e6ad377-7c02-40f6-b9fe-2da849e59050 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:49.590516 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e6ad377-7c02-40f6-b9fe-2da849e59050 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:49.591539 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e6ad377-7c02-40f6-b9fe-2da849e59050 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:49.592196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e6ad377-7c02-40f6-b9fe-2da849e59050 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:49.592820 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e6ad377-7c02-40f6-b9fe-2da849e59050 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:49.660007 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-5644e242-8e14-4d88-a261-4bec9f7ebce4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:49.668784 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-5644e242-8e14-4d88-a261-4bec9f7ebce4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.494082 Aug 05 10:27:49.669321 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e6ad377-7c02-40f6-b9fe-2da849e59050 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:49.671305 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 149/289] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:49 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:49.683290 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e6ad377-7c02-40f6-b9fe-2da849e59050 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:49.683934 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e6ad377-7c02-40f6-b9fe-2da849e59050 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:49.684736 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-2e6ad377-7c02-40f6-b9fe-2da849e59050 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lazy-loading 'fault' on Instance uuid a7ae11ba-1225-48ce-b816-2e84d1778111 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:27:49.954838 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2e6ad377-7c02-40f6-b9fe-2da849e59050 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ace48889c484e4fb5fed0f8f80c3288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a56c0fd0c43d4803634f30479187a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:49.984079 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2e6ad377-7c02-40f6-b9fe-2da849e59050 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 200 len: 1304 microversion: 2.1 time: 0.412692 Aug 05 10:27:49.987824 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 141/290] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:49 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 1304 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:27:50.690544 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c2788db7-1709-40e8-97d8-53f7767f2da2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:50.691816 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c2788db7-1709-40e8-97d8-53f7767f2da2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:50.703579 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c2788db7-1709-40e8-97d8-53f7767f2da2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:50.705878 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c2788db7-1709-40e8-97d8-53f7767f2da2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:50.706486 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c2788db7-1709-40e8-97d8-53f7767f2da2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:50.708473 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c2788db7-1709-40e8-97d8-53f7767f2da2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:50.715076 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c2788db7-1709-40e8-97d8-53f7767f2da2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:50.715770 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c2788db7-1709-40e8-97d8-53f7767f2da2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:50.761282 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-92d7af7c-9747-4ff1-86f8-3541a679f20e req-cb5d1fd4-6f31-4059-bfb4-d88336aed58a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af7c11c7-dddb-481d-9d57-af021c48e71b", "tag": "9e68983d-a83c-49ba-ac19-3c316e21a882"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:27:50.783518 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:27:50.786659 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-92d7af7c-9747-4ff1-86f8-3541a679f20e req-cb5d1fd4-6f31-4059-bfb4-d88336aed58a service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:50.787420 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-92d7af7c-9747-4ff1-86f8-3541a679f20e req-cb5d1fd4-6f31-4059-bfb4-d88336aed58a service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:50.788086 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-92d7af7c-9747-4ff1-86f8-3541a679f20e req-cb5d1fd4-6f31-4059-bfb4-d88336aed58a service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:50.818760 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-92d7af7c-9747-4ff1-86f8-3541a679f20e req-cb5d1fd4-6f31-4059-bfb4-d88336aed58a service nova] Creating event network-changed:9e68983d-a83c-49ba-ac19-3c316e21a882 for instance af7c11c7-dddb-481d-9d57-af021c48e71b on hv-cinder-81558 Aug 05 10:27:50.826773 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-92d7af7c-9747-4ff1-86f8-3541a679f20e req-cb5d1fd4-6f31-4059-bfb4-d88336aed58a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069343 Aug 05 10:27:50.827505 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 142/291] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:27:50.953543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c2788db7-1709-40e8-97d8-53f7767f2da2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:50.964388 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c2788db7-1709-40e8-97d8-53f7767f2da2 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.278538 Aug 05 10:27:50.968699 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 150/292] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:50 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:51.010492 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6eeeda44-01ac-4660-8050-1bb25ccb3b7a tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:51.013170 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6eeeda44-01ac-4660-8050-1bb25ccb3b7a tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:51.036997 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6eeeda44-01ac-4660-8050-1bb25ccb3b7a tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:51.039539 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6eeeda44-01ac-4660-8050-1bb25ccb3b7a tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:51.044276 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6eeeda44-01ac-4660-8050-1bb25ccb3b7a tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:51.045899 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6eeeda44-01ac-4660-8050-1bb25ccb3b7a tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:51.046510 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6eeeda44-01ac-4660-8050-1bb25ccb3b7a tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:51.047734 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6eeeda44-01ac-4660-8050-1bb25ccb3b7a tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:51.070517 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-6eeeda44-01ac-4660-8050-1bb25ccb3b7a tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] HTTP exception thrown: Instance a7ae11ba-1225-48ce-b816-2e84d1778111 could not be found. Aug 05 10:27:51.077621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6eeeda44-01ac-4660-8050-1bb25ccb3b7a tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Request method failure captured: Aug 05 10:27:51.077621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 HTTP/1.1 Aug 05 10:27:51.077621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:27:51.077621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:27:51.077621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:27:51.077621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:27:51.077621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:27:51.077621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:27:51.077621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:27:51.077621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:27:51.077621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PBPhUZlt-YeR9i9H88LcCtAK2iq9OI95VHDLtE8ytppekfN0dHZoqn-7Vx7P6hgvNDPehP1AgVRFKc5GvS0rU2K93E-NVMHnlV2VM7cmzg9zRPdQea8OcavqIE1MBpnCx4FwQemyqM_6tHLch-bIfdhWNTuh5jqxnnqJXEt6sdkh_w Aug 05 10:27:51.077621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:27:51.077621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:27:51.077621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:27:51.077621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:27:51.077621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:27:51.077621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:27:51.077621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 5a7a56c0fd0c43d4803634f30479187a Aug 05 10:27:51.077621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-DeleteServersTestJSON-1595848165 Aug 05 10:27:51.077621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:27:51.077621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:27:51.079242 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5a7a56c0fd0c43d4803634f30479187a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5a7a56c0fd0c43d4803634f30479187a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a7a56c0fd0c43d4803634f30479187a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a7a56c0fd0c43d4803634f30479187a"}]}] Aug 05 10:27:51.079242 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-DeleteServersTestJSON-1595848165 Aug 05 10:27:51.079242 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 5a7a56c0fd0c43d4803634f30479187a Aug 05 10:27:51.079242 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1595848165 Aug 05 10:27:51.079242 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-DeleteServersTestJSON-1595848165-project Aug 05 10:27:51.079242 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:27:51.079242 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:27:51.079242 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: 9ace48889c484e4fb5fed0f8f80c3288 Aug 05 10:27:51.079242 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-DeleteServersTestJSON-1595848165-project Aug 05 10:27:51.079242 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:27:51.079242 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Instance a7ae11ba-1225-48ce-b816-2e84d1778111 could not be found. Aug 05 10:27:51.079242 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': 'a7ae11ba-1225-48ce-b816-2e84d1778111'} Aug 05 10:27:51.080133 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:27:51.080133 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:27:51.080133 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:27:51.080133 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:27:51.080133 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:27:51.080133 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:27:51.080133 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:27:51.080133 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:27:51.080133 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:27:51.080133 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:27:51.080133 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7ae11ba-1225-48ce-b816-2e84d1778111 could not be found. Aug 05 10:27:51.080133 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:27:51.080133 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:27:51.080133 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:27:51.080133 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:27:51.080133 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:27:51.080133 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:27:51.080133 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:27:51.080133 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:27:51.080133 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:27:51.081489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:27:51.081489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:27:51.081489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:27:51.081489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:27:51.081489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:27:51.081489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:27:51.081489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:27:51.081489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7ae11ba-1225-48ce-b816-2e84d1778111 could not be found. Aug 05 10:27:51.081489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:27:51.081489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:27:51.081489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:27:51.081489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:27:51.081489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:27:51.081489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:27:51.081489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:27:51.081489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:27:51.081489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7ae11ba-1225-48ce-b816-2e84d1778111 could not be found. Aug 05 10:27:51.081489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:27:51.082747 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6eeeda44-01ac-4660-8050-1bb25ccb3b7a tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Returning 404 to user: Instance a7ae11ba-1225-48ce-b816-2e84d1778111 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:27:51.083941 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6eeeda44-01ac-4660-8050-1bb25ccb3b7a tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 404 len: 111 microversion: 2.1 time: 0.078693 Aug 05 10:27:51.086959 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 143/293] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:51 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:27:51.339547 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-bea90a73-50cc-4eab-a205-dd0924dba0ca tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:51.343543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-bea90a73-50cc-4eab-a205-dd0924dba0ca tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:51.355974 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bea90a73-50cc-4eab-a205-dd0924dba0ca tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:51.357361 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bea90a73-50cc-4eab-a205-dd0924dba0ca tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:51.358781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bea90a73-50cc-4eab-a205-dd0924dba0ca tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:51.361365 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bea90a73-50cc-4eab-a205-dd0924dba0ca tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:51.362010 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bea90a73-50cc-4eab-a205-dd0924dba0ca tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:51.363354 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bea90a73-50cc-4eab-a205-dd0924dba0ca tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:51.392127 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-bea90a73-50cc-4eab-a205-dd0924dba0ca tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] HTTP exception thrown: Instance a7ae11ba-1225-48ce-b816-2e84d1778111 could not be found. Aug 05 10:27:51.396517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-bea90a73-50cc-4eab-a205-dd0924dba0ca tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Request method failure captured: Aug 05 10:27:51.396517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111/os-volume_attachments HTTP/1.1 Aug 05 10:27:51.396517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:27:51.396517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:27:51.396517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:27:51.396517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:27:51.396517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:27:51.396517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:27:51.396517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:27:51.396517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:27:51.396517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PBPhUZlt-YeR9i9H88LcCtAK2iq9OI95VHDLtE8ytppekfN0dHZoqn-7Vx7P6hgvNDPehP1AgVRFKc5GvS0rU2K93E-NVMHnlV2VM7cmzg9zRPdQea8OcavqIE1MBpnCx4FwQemyqM_6tHLch-bIfdhWNTuh5jqxnnqJXEt6sdkh_w Aug 05 10:27:51.396517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:27:51.396517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:27:51.396517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:27:51.396517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:27:51.396517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:27:51.396517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:27:51.396517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 5a7a56c0fd0c43d4803634f30479187a Aug 05 10:27:51.396517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-DeleteServersTestJSON-1595848165 Aug 05 10:27:51.396517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:27:51.396517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:27:51.398141 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5a7a56c0fd0c43d4803634f30479187a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5a7a56c0fd0c43d4803634f30479187a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a7a56c0fd0c43d4803634f30479187a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a7a56c0fd0c43d4803634f30479187a"}]}] Aug 05 10:27:51.398141 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-DeleteServersTestJSON-1595848165 Aug 05 10:27:51.398141 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 5a7a56c0fd0c43d4803634f30479187a Aug 05 10:27:51.398141 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-DeleteServersTestJSON-1595848165 Aug 05 10:27:51.398141 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-DeleteServersTestJSON-1595848165-project Aug 05 10:27:51.398141 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:27:51.398141 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:27:51.398141 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: 9ace48889c484e4fb5fed0f8f80c3288 Aug 05 10:27:51.398141 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-DeleteServersTestJSON-1595848165-project Aug 05 10:27:51.398141 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: > Aug 05 10:27:51.398141 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Instance a7ae11ba-1225-48ce-b816-2e84d1778111 could not be found. Aug 05 10:27:51.398141 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'server_id': 'a7ae11ba-1225-48ce-b816-2e84d1778111'} Aug 05 10:27:51.399571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:27:51.399571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:27:51.399571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:27:51.399571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:27:51.399571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:27:51.399571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:27:51.399571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:27:51.399571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:27:51.399571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:27:51.399571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:27:51.399571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7ae11ba-1225-48ce-b816-2e84d1778111 could not be found. Aug 05 10:27:51.399571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:27:51.399571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:27:51.399571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:27:51.399571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:27:51.399571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:27:51.399571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:27:51.399571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:27:51.399571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:27:51.399571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:27:51.401418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:27:51.401418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 05 10:27:51.401418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 10:27:51.401418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 05 10:27:51.401418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 10:27:51.401418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 05 10:27:51.401418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 05 10:27:51.401418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:27:51.401418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:27:51.401418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7ae11ba-1225-48ce-b816-2e84d1778111 could not be found. Aug 05 10:27:51.401418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:27:51.401418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:27:51.401418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:27:51.401418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:27:51.401418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:27:51.401418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:27:51.401418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:27:51.401418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:27:51.401418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7ae11ba-1225-48ce-b816-2e84d1778111 could not be found. Aug 05 10:27:51.401418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:27:51.405142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-bea90a73-50cc-4eab-a205-dd0924dba0ca tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Returning 404 to user: Instance a7ae11ba-1225-48ce-b816-2e84d1778111 could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:27:51.405142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-bea90a73-50cc-4eab-a205-dd0924dba0ca tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.063359 Aug 05 10:27:51.405142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 151/294] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 10:27:51 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111/os-volume_attachments => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:27:51.999188 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-83f47114-8f94-4227-9d87-2821a6c3ae79 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:52.000823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-83f47114-8f94-4227-9d87-2821a6c3ae79 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:52.016664 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83f47114-8f94-4227-9d87-2821a6c3ae79 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:52.020539 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83f47114-8f94-4227-9d87-2821a6c3ae79 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:52.021314 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83f47114-8f94-4227-9d87-2821a6c3ae79 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:52.023544 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83f47114-8f94-4227-9d87-2821a6c3ae79 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:52.024332 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83f47114-8f94-4227-9d87-2821a6c3ae79 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:52.038446 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83f47114-8f94-4227-9d87-2821a6c3ae79 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:52.292089 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-83f47114-8f94-4227-9d87-2821a6c3ae79 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:52.305024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-83f47114-8f94-4227-9d87-2821a6c3ae79 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.314054 Aug 05 10:27:52.307433 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 144/295] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:51 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:52.803973 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ae0c9774-cedb-46b7-9f0d-db28ab869834 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:52.804647 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-ae0c9774-cedb-46b7-9f0d-db28ab869834 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:52.817515 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ae0c9774-cedb-46b7-9f0d-db28ab869834 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:52.817948 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ae0c9774-cedb-46b7-9f0d-db28ab869834 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:52.818467 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ae0c9774-cedb-46b7-9f0d-db28ab869834 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:52.819211 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ae0c9774-cedb-46b7-9f0d-db28ab869834 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:52.823625 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ae0c9774-cedb-46b7-9f0d-db28ab869834 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:52.824076 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ae0c9774-cedb-46b7-9f0d-db28ab869834 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:52.852337 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-ae0c9774-cedb-46b7-9f0d-db28ab869834 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] HTTP exception thrown: Instance a7ae11ba-1225-48ce-b816-2e84d1778111 could not be found. Aug 05 10:27:52.855073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ae0c9774-cedb-46b7-9f0d-db28ab869834 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Request method failure captured: Aug 05 10:27:52.855073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: DELETE /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 HTTP/1.1 Aug 05 10:27:52.855073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:27:52.855073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:27:52.855073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:27:52.855073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:27:52.855073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:27:52.855073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:27:52.855073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:27:52.855073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:27:52.855073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PBPhUZlt-YeR9i9H88LcCtAK2iq9OI95VHDLtE8ytppekfN0dHZoqn-7Vx7P6hgvNDPehP1AgVRFKc5GvS0rU2K93E-NVMHnlV2VM7cmzg9zRPdQea8OcavqIE1MBpnCx4FwQemyqM_6tHLch-bIfdhWNTuh5jqxnnqJXEt6sdkh_w Aug 05 10:27:52.855073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:27:52.855073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:27:52.855073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:27:52.855073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:27:52.855073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:27:52.855073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:27:52.855073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 5a7a56c0fd0c43d4803634f30479187a Aug 05 10:27:52.855073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-DeleteServersTestJSON-1595848165 Aug 05 10:27:52.855073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:27:52.855073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:27:52.856237 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5a7a56c0fd0c43d4803634f30479187a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5a7a56c0fd0c43d4803634f30479187a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a7a56c0fd0c43d4803634f30479187a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a7a56c0fd0c43d4803634f30479187a"}]}] Aug 05 10:27:52.856237 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-DeleteServersTestJSON-1595848165 Aug 05 10:27:52.856237 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 5a7a56c0fd0c43d4803634f30479187a Aug 05 10:27:52.856237 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-DeleteServersTestJSON-1595848165 Aug 05 10:27:52.856237 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-DeleteServersTestJSON-1595848165-project Aug 05 10:27:52.856237 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:27:52.856237 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:27:52.856237 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: 9ace48889c484e4fb5fed0f8f80c3288 Aug 05 10:27:52.856237 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-DeleteServersTestJSON-1595848165-project Aug 05 10:27:52.856237 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: > Aug 05 10:27:52.856237 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Instance a7ae11ba-1225-48ce-b816-2e84d1778111 could not be found. Aug 05 10:27:52.856237 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'id': 'a7ae11ba-1225-48ce-b816-2e84d1778111'} Aug 05 10:27:52.856969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:27:52.856969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:27:52.856969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:27:52.856969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:27:52.856969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:27:52.856969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:27:52.856969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:27:52.856969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:27:52.856969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:27:52.856969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:27:52.856969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7ae11ba-1225-48ce-b816-2e84d1778111 could not be found. Aug 05 10:27:52.856969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:27:52.856969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:27:52.856969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:27:52.856969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:27:52.856969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:27:52.856969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:27:52.856969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:27:52.856969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:27:52.856969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:27:52.858103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:27:52.858103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 10:27:52.858103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 10:27:52.858103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 10:27:52.858103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 10:27:52.858103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:27:52.858103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:27:52.858103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:27:52.858103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:27:52.858103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7ae11ba-1225-48ce-b816-2e84d1778111 could not be found. Aug 05 10:27:52.858103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:27:52.858103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:27:52.858103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:27:52.858103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:27:52.858103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:27:52.858103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:27:52.858103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:27:52.858103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:27:52.858103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7ae11ba-1225-48ce-b816-2e84d1778111 could not be found. Aug 05 10:27:52.858103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:27:52.861519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ae0c9774-cedb-46b7-9f0d-db28ab869834 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Returning 404 to user: Instance a7ae11ba-1225-48ce-b816-2e84d1778111 could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:27:52.862563 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ae0c9774-cedb-46b7-9f0d-db28ab869834 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 404 len: 111 microversion: 2.1 time: 0.062703 Aug 05 10:27:52.863626 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 152/296] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:27:52 2022] DELETE /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:27:52.871937 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e23c30d8-6aaf-4d4b-860e-fbedc53091c7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:52.872996 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e23c30d8-6aaf-4d4b-860e-fbedc53091c7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] [instance: a7ae11ba-1225-48ce-b816-2e84d1778111] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:52.884536 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e23c30d8-6aaf-4d4b-860e-fbedc53091c7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:52.887152 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e23c30d8-6aaf-4d4b-860e-fbedc53091c7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:52.887612 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e23c30d8-6aaf-4d4b-860e-fbedc53091c7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:52.888337 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e23c30d8-6aaf-4d4b-860e-fbedc53091c7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:52.888796 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e23c30d8-6aaf-4d4b-860e-fbedc53091c7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:52.889220 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e23c30d8-6aaf-4d4b-860e-fbedc53091c7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:52.910435 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-e23c30d8-6aaf-4d4b-860e-fbedc53091c7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] HTTP exception thrown: Instance a7ae11ba-1225-48ce-b816-2e84d1778111 could not be found. Aug 05 10:27:52.913755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e23c30d8-6aaf-4d4b-860e-fbedc53091c7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Request method failure captured: Aug 05 10:27:52.913755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 HTTP/1.1 Aug 05 10:27:52.913755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:27:52.913755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:27:52.913755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:27:52.913755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:27:52.913755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:27:52.913755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:27:52.913755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:27:52.913755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:27:52.913755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PBPhUZlt-YeR9i9H88LcCtAK2iq9OI95VHDLtE8ytppekfN0dHZoqn-7Vx7P6hgvNDPehP1AgVRFKc5GvS0rU2K93E-NVMHnlV2VM7cmzg9zRPdQea8OcavqIE1MBpnCx4FwQemyqM_6tHLch-bIfdhWNTuh5jqxnnqJXEt6sdkh_w Aug 05 10:27:52.913755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:27:52.913755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:27:52.913755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:27:52.913755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:27:52.913755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:27:52.913755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:27:52.913755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 5a7a56c0fd0c43d4803634f30479187a Aug 05 10:27:52.913755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-DeleteServersTestJSON-1595848165 Aug 05 10:27:52.913755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:27:52.913755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:27:52.915146 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5a7a56c0fd0c43d4803634f30479187a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5a7a56c0fd0c43d4803634f30479187a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a7a56c0fd0c43d4803634f30479187a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a7a56c0fd0c43d4803634f30479187a"}]}] Aug 05 10:27:52.915146 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-DeleteServersTestJSON-1595848165 Aug 05 10:27:52.915146 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 5a7a56c0fd0c43d4803634f30479187a Aug 05 10:27:52.915146 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1595848165 Aug 05 10:27:52.915146 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-DeleteServersTestJSON-1595848165-project Aug 05 10:27:52.915146 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:27:52.915146 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:27:52.915146 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: 9ace48889c484e4fb5fed0f8f80c3288 Aug 05 10:27:52.915146 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-DeleteServersTestJSON-1595848165-project Aug 05 10:27:52.915146 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:27:52.915146 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Instance a7ae11ba-1225-48ce-b816-2e84d1778111 could not be found. Aug 05 10:27:52.915146 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': 'a7ae11ba-1225-48ce-b816-2e84d1778111'} Aug 05 10:27:52.915823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:27:52.915823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:27:52.915823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:27:52.915823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:27:52.915823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:27:52.915823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:27:52.915823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:27:52.915823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:27:52.915823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:27:52.915823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:27:52.915823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7ae11ba-1225-48ce-b816-2e84d1778111 could not be found. Aug 05 10:27:52.915823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:27:52.915823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:27:52.915823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:27:52.915823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:27:52.915823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:27:52.915823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:27:52.915823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:27:52.915823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:27:52.915823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:27:52.916888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:27:52.916888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:27:52.916888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:27:52.916888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:27:52.916888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:27:52.916888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:27:52.916888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:27:52.916888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7ae11ba-1225-48ce-b816-2e84d1778111 could not be found. Aug 05 10:27:52.916888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:27:52.916888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:27:52.916888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:27:52.916888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:27:52.916888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:27:52.916888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:27:52.916888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:27:52.916888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:27:52.916888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7ae11ba-1225-48ce-b816-2e84d1778111 could not be found. Aug 05 10:27:52.916888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:27:52.919592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e23c30d8-6aaf-4d4b-860e-fbedc53091c7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] Returning 404 to user: Instance a7ae11ba-1225-48ce-b816-2e84d1778111 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:27:52.919592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e23c30d8-6aaf-4d4b-860e-fbedc53091c7 tempest-DeleteServersTestJSON-1595848165 tempest-DeleteServersTestJSON-1595848165-project] 10.222.0.40 "GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111" status: 404 len: 111 microversion: 2.1 time: 0.048622 Aug 05 10:27:52.923159 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 145/297] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:52 2022] GET /compute/v2.1/servers/a7ae11ba-1225-48ce-b816-2e84d1778111 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:27:53.330330 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-edd2872b-0872-4f94-9896-047f3e4cc82c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:53.331259 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-edd2872b-0872-4f94-9896-047f3e4cc82c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:53.341052 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-edd2872b-0872-4f94-9896-047f3e4cc82c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:53.344299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-edd2872b-0872-4f94-9896-047f3e4cc82c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:53.351098 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-edd2872b-0872-4f94-9896-047f3e4cc82c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:53.353341 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-edd2872b-0872-4f94-9896-047f3e4cc82c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:53.355119 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-edd2872b-0872-4f94-9896-047f3e4cc82c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:53.355712 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-edd2872b-0872-4f94-9896-047f3e4cc82c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:53.719205 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-edd2872b-0872-4f94-9896-047f3e4cc82c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:53.730949 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-edd2872b-0872-4f94-9896-047f3e4cc82c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.405147 Aug 05 10:27:53.732230 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 153/298] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:53 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:54.760570 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d5b757fe-04fd-48b6-bb1a-488e7be9e957 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:54.761868 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d5b757fe-04fd-48b6-bb1a-488e7be9e957 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:54.771533 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d5b757fe-04fd-48b6-bb1a-488e7be9e957 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:54.772339 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d5b757fe-04fd-48b6-bb1a-488e7be9e957 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:54.772921 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d5b757fe-04fd-48b6-bb1a-488e7be9e957 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:54.774545 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d5b757fe-04fd-48b6-bb1a-488e7be9e957 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:54.775388 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d5b757fe-04fd-48b6-bb1a-488e7be9e957 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:54.776405 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d5b757fe-04fd-48b6-bb1a-488e7be9e957 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:55.020357 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d5b757fe-04fd-48b6-bb1a-488e7be9e957 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:55.031495 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d5b757fe-04fd-48b6-bb1a-488e7be9e957 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.281891 Aug 05 10:27:55.032075 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 146/299] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:54 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:56.053904 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-23c23a28-51d9-4ff0-b253-3956e8cee06b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:56.055505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-23c23a28-51d9-4ff0-b253-3956e8cee06b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:56.067756 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-23c23a28-51d9-4ff0-b253-3956e8cee06b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:56.068924 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-23c23a28-51d9-4ff0-b253-3956e8cee06b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:56.072606 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-23c23a28-51d9-4ff0-b253-3956e8cee06b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:56.073709 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-23c23a28-51d9-4ff0-b253-3956e8cee06b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:56.074428 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-23c23a28-51d9-4ff0-b253-3956e8cee06b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:56.075343 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-23c23a28-51d9-4ff0-b253-3956e8cee06b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:56.353402 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-23c23a28-51d9-4ff0-b253-3956e8cee06b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:56.363777 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-23c23a28-51d9-4ff0-b253-3956e8cee06b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.313667 Aug 05 10:27:56.377458 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 154/300] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:56 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:56.515936 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-99e58754-bc78-414d-ba2a-766e216f74bc tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Action: 'create', calling method: .version_select at 0x7f73277bd820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-849845751", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByH9wYTuperS9mYtrtC8Ul7m/bna8HmKVxRntUQSYnhWTacSc7dWR2m76xRHGQo4G3wA61CsBsvR2Jy0n96Vdun3YbTP9pZtKLxuF9dcdG1FZrB6+oj0mVk65vN1tzcbg=="}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:27:56.534325 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-99e58754-bc78-414d-ba2a-766e216f74bc tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Getting quotas for project db2897585ac048ae93df3e38d1437e6e. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:27:56.540510 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-99e58754-bc78-414d-ba2a-766e216f74bc tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Getting quotas for user 9697af06b1104425aed6692ba4f29238 and project db2897585ac048ae93df3e38d1437e6e. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:27:56.565376 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-99e58754-bc78-414d-ba2a-766e216f74bc tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.054425 Aug 05 10:27:56.566324 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 147/301] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 5 10:27:56 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:27:56.721948 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-9acce974-dafc-495b-9e69-60221d8c7cd4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-257376983", "imageRef": "de1d8519-5f76-40e1-865a-2dfb7b157f69", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-849845751", "networks": [{"uuid": "104a78a7-b956-42f1-a215-f56bc8f4696e"}]}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:27:56.790582 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.network.neutron [None req-9acce974-dafc-495b-9e69-60221d8c7cd4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] validate_networks() for [('104a78a7-b956-42f1-a215-f56bc8f4696e', None, None, None, None, None)] {{(pid=117831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 10:27:57.387389 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c12f09e6-cd89-4b62-a741-2551d4e79995 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:57.388538 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c12f09e6-cd89-4b62-a741-2551d4e79995 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:57.408624 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c12f09e6-cd89-4b62-a741-2551d4e79995 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:57.409638 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c12f09e6-cd89-4b62-a741-2551d4e79995 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:57.410827 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c12f09e6-cd89-4b62-a741-2551d4e79995 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:57.411863 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c12f09e6-cd89-4b62-a741-2551d4e79995 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:57.412472 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c12f09e6-cd89-4b62-a741-2551d4e79995 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:57.413309 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c12f09e6-cd89-4b62-a741-2551d4e79995 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:57.450050 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:27:57.494494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-9acce974-dafc-495b-9e69-60221d8c7cd4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Flavor limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 10:27:57.496477 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-9acce974-dafc-495b-9e69-60221d8c7cd4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Image limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 10:27:57.497196 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-9acce974-dafc-495b-9e69-60221d8c7cd4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Flavor pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 10:27:57.497782 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-9acce974-dafc-495b-9e69-60221d8c7cd4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Image pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 10:27:57.498199 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-9acce974-dafc-495b-9e69-60221d8c7cd4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 10:27:57.507921 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9acce974-dafc-495b-9e69-60221d8c7cd4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:57.508505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9acce974-dafc-495b-9e69-60221d8c7cd4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:57.509092 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9acce974-dafc-495b-9e69-60221d8c7cd4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:57.509947 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9acce974-dafc-495b-9e69-60221d8c7cd4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:57.510420 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9acce974-dafc-495b-9e69-60221d8c7cd4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:57.510849 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9acce974-dafc-495b-9e69-60221d8c7cd4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:57.547886 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-9acce974-dafc-495b-9e69-60221d8c7cd4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Getting quotas for project db2897585ac048ae93df3e38d1437e6e. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:27:57.560401 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-9acce974-dafc-495b-9e69-60221d8c7cd4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Getting quotas for user 9697af06b1104425aed6692ba4f29238 and project db2897585ac048ae93df3e38d1437e6e. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:27:57.592421 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-9acce974-dafc-495b-9e69-60221d8c7cd4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Going to run 1 instances... {{(pid=117831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 10:27:57.595657 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-9acce974-dafc-495b-9e69-60221d8c7cd4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de1d8519-5f76-40e1-865a-2dfb7b157f69',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 10:27:57.670151 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c12f09e6-cd89-4b62-a741-2551d4e79995 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:57.682330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c12f09e6-cd89-4b62-a741-2551d4e79995 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.301654 Aug 05 10:27:57.683265 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 148/302] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:57 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:57.689135 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-9acce974-dafc-495b-9e69-60221d8c7cd4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.972893 Aug 05 10:27:57.693817 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 155/303] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 10:27:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 10:27:57.713330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8d55693d-a0f6-4fd7-80c7-b38e57e1119f tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:57.714107 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8d55693d-a0f6-4fd7-80c7-b38e57e1119f tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:57.842496 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8d55693d-a0f6-4fd7-80c7-b38e57e1119f tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:57.850045 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8d55693d-a0f6-4fd7-80c7-b38e57e1119f tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1257 microversion: 2.1 time: 0.148589 Aug 05 10:27:57.865687 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 149/304] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:57 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1257 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:58.712249 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-2cc26177-283b-4406-8dc9-f0dcb9a889a1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:58.713759 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-2cc26177-283b-4406-8dc9-f0dcb9a889a1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:58.718472 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:27:58.724392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2cc26177-283b-4406-8dc9-f0dcb9a889a1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:58.725004 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2cc26177-283b-4406-8dc9-f0dcb9a889a1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:58.725608 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2cc26177-283b-4406-8dc9-f0dcb9a889a1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:58.726715 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2cc26177-283b-4406-8dc9-f0dcb9a889a1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:58.727244 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2cc26177-283b-4406-8dc9-f0dcb9a889a1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:58.727626 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2cc26177-283b-4406-8dc9-f0dcb9a889a1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:58.876279 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0afe2be4-0286-4282-8124-291ca6314887 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:58.880753 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0afe2be4-0286-4282-8124-291ca6314887 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:58.893428 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0afe2be4-0286-4282-8124-291ca6314887 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:58.893917 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0afe2be4-0286-4282-8124-291ca6314887 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:58.894374 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0afe2be4-0286-4282-8124-291ca6314887 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:58.895195 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0afe2be4-0286-4282-8124-291ca6314887 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:58.895641 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0afe2be4-0286-4282-8124-291ca6314887 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:58.896050 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0afe2be4-0286-4282-8124-291ca6314887 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:58.902777 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2cc26177-283b-4406-8dc9-f0dcb9a889a1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:58.913038 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-2cc26177-283b-4406-8dc9-f0dcb9a889a1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.206075 Aug 05 10:27:58.915051 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 156/305] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:58 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:27:58.990403 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0afe2be4-0286-4282-8124-291ca6314887 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:27:58.999615 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0afe2be4-0286-4282-8124-291ca6314887 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1261 microversion: 2.1 time: 0.128496 Aug 05 10:27:59.001024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 150/306] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:58 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1261 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:27:59.935999 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-fe0dd1c6-6b52-4f88-911f-2346ab7d73bb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:27:59.936603 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-fe0dd1c6-6b52-4f88-911f-2346ab7d73bb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:27:59.947802 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fe0dd1c6-6b52-4f88-911f-2346ab7d73bb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:59.960792 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fe0dd1c6-6b52-4f88-911f-2346ab7d73bb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:59.961042 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fe0dd1c6-6b52-4f88-911f-2346ab7d73bb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:27:59.961995 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fe0dd1c6-6b52-4f88-911f-2346ab7d73bb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:27:59.962996 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fe0dd1c6-6b52-4f88-911f-2346ab7d73bb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:27:59.963442 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fe0dd1c6-6b52-4f88-911f-2346ab7d73bb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:00.023868 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0158e894-670f-4791-9c30-8ba20fd7da10 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:00.024839 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0158e894-670f-4791-9c30-8ba20fd7da10 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:00.037780 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0158e894-670f-4791-9c30-8ba20fd7da10 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:00.038433 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0158e894-670f-4791-9c30-8ba20fd7da10 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:00.040413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0158e894-670f-4791-9c30-8ba20fd7da10 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:00.041370 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0158e894-670f-4791-9c30-8ba20fd7da10 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:00.042194 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0158e894-670f-4791-9c30-8ba20fd7da10 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:00.044427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0158e894-670f-4791-9c30-8ba20fd7da10 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:00.182822 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0158e894-670f-4791-9c30-8ba20fd7da10 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:00.210357 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0158e894-670f-4791-9c30-8ba20fd7da10 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1327 microversion: 2.1 time: 0.191864 Aug 05 10:28:00.212485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 151/307] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:00 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1327 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:00.328091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-fe0dd1c6-6b52-4f88-911f-2346ab7d73bb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:00.342388 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-fe0dd1c6-6b52-4f88-911f-2346ab7d73bb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.409659 Aug 05 10:28:00.343530 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 157/308] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:27:59 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:01.233607 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a044c2b2-4d2c-405e-9971-d65601a1d69d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:01.235309 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a044c2b2-4d2c-405e-9971-d65601a1d69d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:01.248474 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a044c2b2-4d2c-405e-9971-d65601a1d69d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:01.248990 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a044c2b2-4d2c-405e-9971-d65601a1d69d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:01.249416 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a044c2b2-4d2c-405e-9971-d65601a1d69d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:01.250134 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a044c2b2-4d2c-405e-9971-d65601a1d69d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:01.250590 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a044c2b2-4d2c-405e-9971-d65601a1d69d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:01.251049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a044c2b2-4d2c-405e-9971-d65601a1d69d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:01.371192 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c3257231-de4a-44b4-8907-67505ef29f10 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:01.372066 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c3257231-de4a-44b4-8907-67505ef29f10 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:01.385238 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c3257231-de4a-44b4-8907-67505ef29f10 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:01.386072 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c3257231-de4a-44b4-8907-67505ef29f10 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:01.386072 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c3257231-de4a-44b4-8907-67505ef29f10 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:01.386757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c3257231-de4a-44b4-8907-67505ef29f10 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:01.387235 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c3257231-de4a-44b4-8907-67505ef29f10 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:01.387656 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c3257231-de4a-44b4-8907-67505ef29f10 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:01.412282 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a044c2b2-4d2c-405e-9971-d65601a1d69d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:01.422622 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a044c2b2-4d2c-405e-9971-d65601a1d69d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.193273 Aug 05 10:28:01.423431 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 152/309] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:01 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:01.564905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c3257231-de4a-44b4-8907-67505ef29f10 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:01.570092 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=100 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:28:01.574567 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c3257231-de4a-44b4-8907-67505ef29f10 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.214764 Aug 05 10:28:01.575189 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 158/310] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:01 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:02.448990 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3122ce4f-9956-4482-b99b-2c23546c20b1 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:02.449594 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3122ce4f-9956-4482-b99b-2c23546c20b1 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:02.457730 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3122ce4f-9956-4482-b99b-2c23546c20b1 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:02.458290 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3122ce4f-9956-4482-b99b-2c23546c20b1 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:02.458792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3122ce4f-9956-4482-b99b-2c23546c20b1 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:02.459635 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3122ce4f-9956-4482-b99b-2c23546c20b1 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:02.460159 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3122ce4f-9956-4482-b99b-2c23546c20b1 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:02.461196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3122ce4f-9956-4482-b99b-2c23546c20b1 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:02.594759 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3122ce4f-9956-4482-b99b-2c23546c20b1 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:02.595522 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-21162a7f-b1d2-46f8-bb6e-462d3738b686 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:02.596163 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-21162a7f-b1d2-46f8-bb6e-462d3738b686 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:02.602783 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-21162a7f-b1d2-46f8-bb6e-462d3738b686 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:02.602946 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3122ce4f-9956-4482-b99b-2c23546c20b1 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.160131 Aug 05 10:28:02.603296 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-21162a7f-b1d2-46f8-bb6e-462d3738b686 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:02.603438 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 153/311] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:02 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:02.603720 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-21162a7f-b1d2-46f8-bb6e-462d3738b686 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:02.604764 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-21162a7f-b1d2-46f8-bb6e-462d3738b686 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:02.605221 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-21162a7f-b1d2-46f8-bb6e-462d3738b686 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:02.605648 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-21162a7f-b1d2-46f8-bb6e-462d3738b686 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:02.750038 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-21162a7f-b1d2-46f8-bb6e-462d3738b686 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:02.758097 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-21162a7f-b1d2-46f8-bb6e-462d3738b686 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.166351 Aug 05 10:28:02.758671 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 159/312] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:02 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:03.623779 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a6702878-5238-47e3-97fb-3a274af72b2f tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:03.624379 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a6702878-5238-47e3-97fb-3a274af72b2f tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:03.632702 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6702878-5238-47e3-97fb-3a274af72b2f tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:03.633250 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6702878-5238-47e3-97fb-3a274af72b2f tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:03.633847 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6702878-5238-47e3-97fb-3a274af72b2f tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:03.634858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6702878-5238-47e3-97fb-3a274af72b2f tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:03.635483 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6702878-5238-47e3-97fb-3a274af72b2f tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:03.636030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6702878-5238-47e3-97fb-3a274af72b2f tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:03.779871 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-4a03dfc4-ef28-4453-9008-422b3737ced5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:03.780553 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-4a03dfc4-ef28-4453-9008-422b3737ced5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:03.780753 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a6702878-5238-47e3-97fb-3a274af72b2f tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:03.787316 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4a03dfc4-ef28-4453-9008-422b3737ced5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:03.787803 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4a03dfc4-ef28-4453-9008-422b3737ced5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:03.788238 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4a03dfc4-ef28-4453-9008-422b3737ced5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:03.788850 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a6702878-5238-47e3-97fb-3a274af72b2f tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.168891 Aug 05 10:28:03.789422 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 154/313] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:03 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:03.789550 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4a03dfc4-ef28-4453-9008-422b3737ced5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:03.789912 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4a03dfc4-ef28-4453-9008-422b3737ced5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:03.790337 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4a03dfc4-ef28-4453-9008-422b3737ced5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:03.927882 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-4a03dfc4-ef28-4453-9008-422b3737ced5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:03.939750 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-4a03dfc4-ef28-4453-9008-422b3737ced5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.163746 Aug 05 10:28:03.940590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 160/314] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:03 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:04.811033 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-91ef5c4b-2858-4558-9b7e-be9455ab2760 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:04.811757 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-91ef5c4b-2858-4558-9b7e-be9455ab2760 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:04.819895 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-91ef5c4b-2858-4558-9b7e-be9455ab2760 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:04.820386 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-91ef5c4b-2858-4558-9b7e-be9455ab2760 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:04.820816 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-91ef5c4b-2858-4558-9b7e-be9455ab2760 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:04.821516 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-91ef5c4b-2858-4558-9b7e-be9455ab2760 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:04.821973 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-91ef5c4b-2858-4558-9b7e-be9455ab2760 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:04.822421 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-91ef5c4b-2858-4558-9b7e-be9455ab2760 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:04.963694 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f04efc07-71fa-4548-a262-1bdfad64732e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:04.964339 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f04efc07-71fa-4548-a262-1bdfad64732e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:04.967287 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-91ef5c4b-2858-4558-9b7e-be9455ab2760 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:04.971653 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f04efc07-71fa-4548-a262-1bdfad64732e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:04.972249 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f04efc07-71fa-4548-a262-1bdfad64732e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:04.972715 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f04efc07-71fa-4548-a262-1bdfad64732e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:04.973700 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f04efc07-71fa-4548-a262-1bdfad64732e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:04.974259 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f04efc07-71fa-4548-a262-1bdfad64732e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:04.974748 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f04efc07-71fa-4548-a262-1bdfad64732e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:04.975570 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-91ef5c4b-2858-4558-9b7e-be9455ab2760 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.169213 Aug 05 10:28:04.976518 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 155/315] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:04 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:05.113951 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-f04efc07-71fa-4548-a262-1bdfad64732e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:05.122282 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f04efc07-71fa-4548-a262-1bdfad64732e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.163236 Aug 05 10:28:05.122849 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 161/316] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:04 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:28:05.997560 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-452df4df-f7bf-4bd3-b671-0a630c991de4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:05.998238 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-452df4df-f7bf-4bd3-b671-0a630c991de4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:06.005112 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-452df4df-f7bf-4bd3-b671-0a630c991de4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:06.005590 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-452df4df-f7bf-4bd3-b671-0a630c991de4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:06.006075 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-452df4df-f7bf-4bd3-b671-0a630c991de4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:06.006758 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-452df4df-f7bf-4bd3-b671-0a630c991de4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:06.007263 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-452df4df-f7bf-4bd3-b671-0a630c991de4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:06.007674 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-452df4df-f7bf-4bd3-b671-0a630c991de4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:06.148077 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-3b7c2785-a00e-4589-9ec2-fd7efd27ebbf tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:06.148655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-3b7c2785-a00e-4589-9ec2-fd7efd27ebbf tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:06.150645 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-452df4df-f7bf-4bd3-b671-0a630c991de4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:06.155881 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3b7c2785-a00e-4589-9ec2-fd7efd27ebbf tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:06.156514 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3b7c2785-a00e-4589-9ec2-fd7efd27ebbf tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:06.157275 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3b7c2785-a00e-4589-9ec2-fd7efd27ebbf tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:06.158237 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3b7c2785-a00e-4589-9ec2-fd7efd27ebbf tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:06.158780 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-452df4df-f7bf-4bd3-b671-0a630c991de4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.165504 Aug 05 10:28:06.159358 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3b7c2785-a00e-4589-9ec2-fd7efd27ebbf tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:06.159492 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 156/317] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:05 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:06.160501 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3b7c2785-a00e-4589-9ec2-fd7efd27ebbf tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:06.298890 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-3b7c2785-a00e-4589-9ec2-fd7efd27ebbf tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:06.310136 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-3b7c2785-a00e-4589-9ec2-fd7efd27ebbf tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.165915 Aug 05 10:28:06.310966 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 162/318] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:06 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:07.182552 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fc200e57-b43c-4536-a901-f6fd226c9328 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:07.183261 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fc200e57-b43c-4536-a901-f6fd226c9328 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:07.191433 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc200e57-b43c-4536-a901-f6fd226c9328 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:07.192405 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc200e57-b43c-4536-a901-f6fd226c9328 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:07.192740 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc200e57-b43c-4536-a901-f6fd226c9328 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:07.193612 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc200e57-b43c-4536-a901-f6fd226c9328 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:07.194035 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc200e57-b43c-4536-a901-f6fd226c9328 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:07.194634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc200e57-b43c-4536-a901-f6fd226c9328 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:07.332517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-cb27c499-1256-42ec-be81-318bf1d1a6e1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:07.333345 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-cb27c499-1256-42ec-be81-318bf1d1a6e1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:07.355052 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cb27c499-1256-42ec-be81-318bf1d1a6e1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:07.355546 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cb27c499-1256-42ec-be81-318bf1d1a6e1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:07.355992 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cb27c499-1256-42ec-be81-318bf1d1a6e1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:07.356696 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cb27c499-1256-42ec-be81-318bf1d1a6e1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:07.357152 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cb27c499-1256-42ec-be81-318bf1d1a6e1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:07.357577 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cb27c499-1256-42ec-be81-318bf1d1a6e1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:07.385695 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fc200e57-b43c-4536-a901-f6fd226c9328 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:07.394737 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fc200e57-b43c-4536-a901-f6fd226c9328 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.217499 Aug 05 10:28:07.406927 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 157/319] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:07 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:28:07.497345 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-cb27c499-1256-42ec-be81-318bf1d1a6e1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:07.506799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-cb27c499-1256-42ec-be81-318bf1d1a6e1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.178888 Aug 05 10:28:07.507489 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 163/320] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:07 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:07.871866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0c18f35a-ecd2-4522-b3c3-a82f82a8e85d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1120611070", "imageRef": "6163bb7c-dfd7-4fb1-a3cb-9f4818243f78", "flavorRef": "452", "networks": [{"uuid": "96fa5b29-49f1-4170-a5e8-3eb666666ae8"}]}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:28:07.880995 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:28:07.935552 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-0c18f35a-ecd2-4522-b3c3-a82f82a8e85d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] validate_networks() for [('96fa5b29-49f1-4170-a5e8-3eb666666ae8', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 10:28:08.297063 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-0c18f35a-ecd2-4522-b3c3-a82f82a8e85d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 10:28:08.297658 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-0c18f35a-ecd2-4522-b3c3-a82f82a8e85d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 10:28:08.297936 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-0c18f35a-ecd2-4522-b3c3-a82f82a8e85d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 10:28:08.298336 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-0c18f35a-ecd2-4522-b3c3-a82f82a8e85d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 10:28:08.298735 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-0c18f35a-ecd2-4522-b3c3-a82f82a8e85d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 10:28:08.308373 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c18f35a-ecd2-4522-b3c3-a82f82a8e85d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:08.308980 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c18f35a-ecd2-4522-b3c3-a82f82a8e85d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:08.309405 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c18f35a-ecd2-4522-b3c3-a82f82a8e85d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:08.310120 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c18f35a-ecd2-4522-b3c3-a82f82a8e85d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:08.310570 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c18f35a-ecd2-4522-b3c3-a82f82a8e85d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:08.311034 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c18f35a-ecd2-4522-b3c3-a82f82a8e85d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:08.333359 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-0c18f35a-ecd2-4522-b3c3-a82f82a8e85d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Getting quotas for project a4a8139ee97548e89fcb7b38c5bd99fe. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:28:08.337693 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-0c18f35a-ecd2-4522-b3c3-a82f82a8e85d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Getting quotas for user 7723cdbd378743378b1fccc2d15bc53b and project a4a8139ee97548e89fcb7b38c5bd99fe. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:28:08.350200 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0c18f35a-ecd2-4522-b3c3-a82f82a8e85d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 10:28:08.354142 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0c18f35a-ecd2-4522-b3c3-a82f82a8e85d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6163bb7c-dfd7-4fb1-a3cb-9f4818243f78',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 10:28:08.410869 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0c18f35a-ecd2-4522-b3c3-a82f82a8e85d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538423 Aug 05 10:28:08.410869 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 158/321] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 10:28:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 10:28:08.418255 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-35642706-77d5-4ecb-8fab-366c8cc3a627 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:08.419423 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-35642706-77d5-4ecb-8fab-366c8cc3a627 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:08.423596 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-5638eb45-5dc9-4291-8320-b026f7bb66f8 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:08.424793 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-5638eb45-5dc9-4291-8320-b026f7bb66f8 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:08.433689 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=2 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:28:08.434756 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=6 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:28:08.447215 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5638eb45-5dc9-4291-8320-b026f7bb66f8 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:08.447773 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5638eb45-5dc9-4291-8320-b026f7bb66f8 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:08.448275 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5638eb45-5dc9-4291-8320-b026f7bb66f8 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:08.449245 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5638eb45-5dc9-4291-8320-b026f7bb66f8 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:08.449688 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5638eb45-5dc9-4291-8320-b026f7bb66f8 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:08.450283 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5638eb45-5dc9-4291-8320-b026f7bb66f8 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:08.493762 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-35642706-77d5-4ecb-8fab-366c8cc3a627 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:08.503664 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-35642706-77d5-4ecb-8fab-366c8cc3a627 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1214 microversion: 2.1 time: 0.089529 Aug 05 10:28:08.511931 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 159/322] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:08 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:28:08.569044 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3488f34b-1322-420b-8d3d-a9f5353943fb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:08.572790 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3488f34b-1322-420b-8d3d-a9f5353943fb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:08.582314 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3488f34b-1322-420b-8d3d-a9f5353943fb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:08.583224 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3488f34b-1322-420b-8d3d-a9f5353943fb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:08.583224 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3488f34b-1322-420b-8d3d-a9f5353943fb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:08.583976 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3488f34b-1322-420b-8d3d-a9f5353943fb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:08.584426 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3488f34b-1322-420b-8d3d-a9f5353943fb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:08.584847 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3488f34b-1322-420b-8d3d-a9f5353943fb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:08.732092 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-5638eb45-5dc9-4291-8320-b026f7bb66f8 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:08.744221 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-5638eb45-5dc9-4291-8320-b026f7bb66f8 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.331379 Aug 05 10:28:08.744994 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 164/323] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:08 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:08.846477 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3488f34b-1322-420b-8d3d-a9f5353943fb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:08.865083 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3488f34b-1322-420b-8d3d-a9f5353943fb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.310373 Aug 05 10:28:08.866046 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 160/324] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:08 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:09.527693 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b4c33f3f-9619-41fc-902a-094781561339 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:09.529215 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b4c33f3f-9619-41fc-902a-094781561339 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:09.540493 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b4c33f3f-9619-41fc-902a-094781561339 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:09.541169 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b4c33f3f-9619-41fc-902a-094781561339 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:09.541715 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b4c33f3f-9619-41fc-902a-094781561339 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:09.542575 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b4c33f3f-9619-41fc-902a-094781561339 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:09.543140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b4c33f3f-9619-41fc-902a-094781561339 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:09.543636 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b4c33f3f-9619-41fc-902a-094781561339 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:09.615147 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b4c33f3f-9619-41fc-902a-094781561339 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:09.622834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b4c33f3f-9619-41fc-902a-094781561339 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1218 microversion: 2.1 time: 0.101301 Aug 05 10:28:09.623737 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 165/325] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:09 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:09.765903 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-abbd87f2-de65-436a-a9eb-2349632dcda4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:09.766534 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-abbd87f2-de65-436a-a9eb-2349632dcda4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:09.775336 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-abbd87f2-de65-436a-a9eb-2349632dcda4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:09.775820 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-abbd87f2-de65-436a-a9eb-2349632dcda4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:09.776252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-abbd87f2-de65-436a-a9eb-2349632dcda4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:09.776960 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-abbd87f2-de65-436a-a9eb-2349632dcda4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:09.777411 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-abbd87f2-de65-436a-a9eb-2349632dcda4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:09.777828 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-abbd87f2-de65-436a-a9eb-2349632dcda4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:09.885470 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-da2501af-6944-4a7e-b644-aa0a61deee66 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:09.886095 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-da2501af-6944-4a7e-b644-aa0a61deee66 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:09.892459 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-da2501af-6944-4a7e-b644-aa0a61deee66 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:09.892940 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-da2501af-6944-4a7e-b644-aa0a61deee66 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:09.893363 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-da2501af-6944-4a7e-b644-aa0a61deee66 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:09.894046 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-da2501af-6944-4a7e-b644-aa0a61deee66 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:09.894492 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-da2501af-6944-4a7e-b644-aa0a61deee66 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:09.894926 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-da2501af-6944-4a7e-b644-aa0a61deee66 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:09.957817 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-abbd87f2-de65-436a-a9eb-2349632dcda4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:09.965682 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-abbd87f2-de65-436a-a9eb-2349632dcda4 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.203580 Aug 05 10:28:09.966315 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 161/326] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:09 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:10.052535 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-da2501af-6944-4a7e-b644-aa0a61deee66 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:10.060294 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-da2501af-6944-4a7e-b644-aa0a61deee66 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.178829 Aug 05 10:28:10.060858 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 166/327] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:09 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:28:10.645586 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3b87158d-bb8c-487e-80ca-8c2c8985f01d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:10.646209 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3b87158d-bb8c-487e-80ca-8c2c8985f01d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:10.652727 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b87158d-bb8c-487e-80ca-8c2c8985f01d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:10.653287 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b87158d-bb8c-487e-80ca-8c2c8985f01d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:10.653814 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b87158d-bb8c-487e-80ca-8c2c8985f01d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:10.659112 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b87158d-bb8c-487e-80ca-8c2c8985f01d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:10.660193 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b87158d-bb8c-487e-80ca-8c2c8985f01d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:10.660673 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b87158d-bb8c-487e-80ca-8c2c8985f01d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:10.755403 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3b87158d-bb8c-487e-80ca-8c2c8985f01d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:10.767770 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3b87158d-bb8c-487e-80ca-8c2c8985f01d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1218 microversion: 2.1 time: 0.126952 Aug 05 10:28:10.768545 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 162/328] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:10 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1218 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:10.988126 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-1276d4fb-dba8-4735-a559-facc5387547d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:10.988126 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-1276d4fb-dba8-4735-a559-facc5387547d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:10.999870 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1276d4fb-dba8-4735-a559-facc5387547d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:11.000366 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1276d4fb-dba8-4735-a559-facc5387547d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:11.000806 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1276d4fb-dba8-4735-a559-facc5387547d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:11.001512 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1276d4fb-dba8-4735-a559-facc5387547d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:11.001968 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1276d4fb-dba8-4735-a559-facc5387547d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:11.002397 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1276d4fb-dba8-4735-a559-facc5387547d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:11.088164 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8a11b108-3eea-4e4f-924c-a8c593bb8a39 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:11.088858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8a11b108-3eea-4e4f-924c-a8c593bb8a39 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:11.095683 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a11b108-3eea-4e4f-924c-a8c593bb8a39 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:11.096720 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a11b108-3eea-4e4f-924c-a8c593bb8a39 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:11.096720 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a11b108-3eea-4e4f-924c-a8c593bb8a39 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:11.097972 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a11b108-3eea-4e4f-924c-a8c593bb8a39 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:11.098632 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a11b108-3eea-4e4f-924c-a8c593bb8a39 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:11.099323 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a11b108-3eea-4e4f-924c-a8c593bb8a39 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:11.159022 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-1276d4fb-dba8-4735-a559-facc5387547d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:11.168453 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-1276d4fb-dba8-4735-a559-facc5387547d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.185585 Aug 05 10:28:11.170952 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 167/329] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:10 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:11.391711 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8a11b108-3eea-4e4f-924c-a8c593bb8a39 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:11.399194 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8a11b108-3eea-4e4f-924c-a8c593bb8a39 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.319896 Aug 05 10:28:11.399857 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 163/330] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:11 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:28:11.789864 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-bef1b267-3040-4486-bb3a-ecc09ca63b7c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:11.790722 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-bef1b267-3040-4486-bb3a-ecc09ca63b7c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:11.798851 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bef1b267-3040-4486-bb3a-ecc09ca63b7c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:11.799780 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bef1b267-3040-4486-bb3a-ecc09ca63b7c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:11.800341 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bef1b267-3040-4486-bb3a-ecc09ca63b7c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:11.801127 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bef1b267-3040-4486-bb3a-ecc09ca63b7c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:11.801648 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bef1b267-3040-4486-bb3a-ecc09ca63b7c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:11.802148 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bef1b267-3040-4486-bb3a-ecc09ca63b7c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:11.889341 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-bef1b267-3040-4486-bb3a-ecc09ca63b7c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:11.897706 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-bef1b267-3040-4486-bb3a-ecc09ca63b7c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1218 microversion: 2.1 time: 0.113000 Aug 05 10:28:11.899644 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 168/331] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:11 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:12.189861 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a4914dd7-01e1-4ae1-a50a-26ece5be86b7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:12.191060 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a4914dd7-01e1-4ae1-a50a-26ece5be86b7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:12.205332 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a4914dd7-01e1-4ae1-a50a-26ece5be86b7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:12.206196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a4914dd7-01e1-4ae1-a50a-26ece5be86b7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:12.206939 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a4914dd7-01e1-4ae1-a50a-26ece5be86b7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:12.207682 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a4914dd7-01e1-4ae1-a50a-26ece5be86b7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:12.208217 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a4914dd7-01e1-4ae1-a50a-26ece5be86b7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:12.209000 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a4914dd7-01e1-4ae1-a50a-26ece5be86b7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:12.392689 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a4914dd7-01e1-4ae1-a50a-26ece5be86b7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:12.400660 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a4914dd7-01e1-4ae1-a50a-26ece5be86b7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.214643 Aug 05 10:28:12.401240 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 164/332] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:12 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:12.421224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-436464cf-2beb-4cb5-860a-a3fe7d413dcc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:12.421827 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-436464cf-2beb-4cb5-860a-a3fe7d413dcc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:12.427827 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-436464cf-2beb-4cb5-860a-a3fe7d413dcc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:12.428305 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-436464cf-2beb-4cb5-860a-a3fe7d413dcc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:12.428760 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-436464cf-2beb-4cb5-860a-a3fe7d413dcc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:12.429462 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-436464cf-2beb-4cb5-860a-a3fe7d413dcc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:12.430228 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-436464cf-2beb-4cb5-860a-a3fe7d413dcc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:12.430580 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-436464cf-2beb-4cb5-860a-a3fe7d413dcc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:12.579305 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-436464cf-2beb-4cb5-860a-a3fe7d413dcc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:12.588706 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-436464cf-2beb-4cb5-860a-a3fe7d413dcc tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.171365 Aug 05 10:28:12.589357 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 169/333] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:12 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:12.919441 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-83d9db51-1cdb-425e-be1c-16799e0521df tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:12.920141 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-83d9db51-1cdb-425e-be1c-16799e0521df tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:12.926343 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83d9db51-1cdb-425e-be1c-16799e0521df tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:12.926820 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83d9db51-1cdb-425e-be1c-16799e0521df tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:12.927278 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83d9db51-1cdb-425e-be1c-16799e0521df tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:12.927955 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83d9db51-1cdb-425e-be1c-16799e0521df tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:12.928398 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83d9db51-1cdb-425e-be1c-16799e0521df tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:12.928812 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-83d9db51-1cdb-425e-be1c-16799e0521df tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:12.993496 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-83d9db51-1cdb-425e-be1c-16799e0521df tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:13.001368 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-83d9db51-1cdb-425e-be1c-16799e0521df tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1218 microversion: 2.1 time: 0.085780 Aug 05 10:28:13.001924 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 165/334] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:12 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:28:13.420957 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-2d93a30d-139b-4e8d-8025-cac7a3fcc52e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:13.421576 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-2d93a30d-139b-4e8d-8025-cac7a3fcc52e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:13.429021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2d93a30d-139b-4e8d-8025-cac7a3fcc52e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:13.429563 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2d93a30d-139b-4e8d-8025-cac7a3fcc52e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:13.430183 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2d93a30d-139b-4e8d-8025-cac7a3fcc52e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:13.431235 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2d93a30d-139b-4e8d-8025-cac7a3fcc52e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:13.431698 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2d93a30d-139b-4e8d-8025-cac7a3fcc52e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:13.432283 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2d93a30d-139b-4e8d-8025-cac7a3fcc52e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:13.609784 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-00e601e2-ce5e-4cb4-b879-7ba35d73cbc8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:13.611041 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-00e601e2-ce5e-4cb4-b879-7ba35d73cbc8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:13.618017 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-00e601e2-ce5e-4cb4-b879-7ba35d73cbc8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:13.618728 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-00e601e2-ce5e-4cb4-b879-7ba35d73cbc8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:13.619361 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-00e601e2-ce5e-4cb4-b879-7ba35d73cbc8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:13.620292 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-00e601e2-ce5e-4cb4-b879-7ba35d73cbc8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:13.621565 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-00e601e2-ce5e-4cb4-b879-7ba35d73cbc8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:13.622137 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-00e601e2-ce5e-4cb4-b879-7ba35d73cbc8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:13.646854 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2d93a30d-139b-4e8d-8025-cac7a3fcc52e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:13.655396 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-2d93a30d-139b-4e8d-8025-cac7a3fcc52e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.238173 Aug 05 10:28:13.656099 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 170/335] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:13 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:13.766420 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-00e601e2-ce5e-4cb4-b879-7ba35d73cbc8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:13.776590 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-00e601e2-ce5e-4cb4-b879-7ba35d73cbc8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.170546 Aug 05 10:28:13.777757 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 166/336] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:13 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:28:14.024209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ca6d0e91-f863-4467-bc32-84fede20c495 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:14.025300 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-ca6d0e91-f863-4467-bc32-84fede20c495 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:14.033052 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ca6d0e91-f863-4467-bc32-84fede20c495 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:14.035573 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ca6d0e91-f863-4467-bc32-84fede20c495 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:14.036137 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ca6d0e91-f863-4467-bc32-84fede20c495 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:14.036862 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ca6d0e91-f863-4467-bc32-84fede20c495 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:14.037386 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ca6d0e91-f863-4467-bc32-84fede20c495 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:14.037805 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ca6d0e91-f863-4467-bc32-84fede20c495 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:14.127313 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ca6d0e91-f863-4467-bc32-84fede20c495 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:14.137868 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ca6d0e91-f863-4467-bc32-84fede20c495 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1218 microversion: 2.1 time: 0.118695 Aug 05 10:28:14.152003 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 171/337] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:14 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1218 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:14.675841 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e3d9e972-c2ed-48e7-8386-9fc6d9cc293e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:14.679824 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e3d9e972-c2ed-48e7-8386-9fc6d9cc293e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:14.684299 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3d9e972-c2ed-48e7-8386-9fc6d9cc293e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:14.684781 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3d9e972-c2ed-48e7-8386-9fc6d9cc293e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:14.685209 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3d9e972-c2ed-48e7-8386-9fc6d9cc293e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:14.685924 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3d9e972-c2ed-48e7-8386-9fc6d9cc293e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:14.686371 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3d9e972-c2ed-48e7-8386-9fc6d9cc293e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:14.686789 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3d9e972-c2ed-48e7-8386-9fc6d9cc293e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:14.798376 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f0146bb2-839a-4e98-8119-9698a1506ee8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:14.799146 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f0146bb2-839a-4e98-8119-9698a1506ee8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:14.808366 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f0146bb2-839a-4e98-8119-9698a1506ee8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:14.809933 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f0146bb2-839a-4e98-8119-9698a1506ee8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:14.810440 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f0146bb2-839a-4e98-8119-9698a1506ee8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:14.811206 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f0146bb2-839a-4e98-8119-9698a1506ee8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:14.812482 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f0146bb2-839a-4e98-8119-9698a1506ee8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:14.820173 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e3d9e972-c2ed-48e7-8386-9fc6d9cc293e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:14.820678 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f0146bb2-839a-4e98-8119-9698a1506ee8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:14.826604 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:28:14.833823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e3d9e972-c2ed-48e7-8386-9fc6d9cc293e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.161607 Aug 05 10:28:14.834400 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 167/338] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:14 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:15.009745 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-f0146bb2-839a-4e98-8119-9698a1506ee8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:15.017139 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f0146bb2-839a-4e98-8119-9698a1506ee8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.223368 Aug 05 10:28:15.017710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 172/339] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:14 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:15.162062 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a5761748-2bb4-4046-bb97-d2ef7ee88f7b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:15.163320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a5761748-2bb4-4046-bb97-d2ef7ee88f7b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:15.173539 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a5761748-2bb4-4046-bb97-d2ef7ee88f7b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:15.174028 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a5761748-2bb4-4046-bb97-d2ef7ee88f7b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:15.174458 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a5761748-2bb4-4046-bb97-d2ef7ee88f7b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:15.175189 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a5761748-2bb4-4046-bb97-d2ef7ee88f7b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:15.175804 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a5761748-2bb4-4046-bb97-d2ef7ee88f7b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:15.176230 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a5761748-2bb4-4046-bb97-d2ef7ee88f7b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:15.259535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a5761748-2bb4-4046-bb97-d2ef7ee88f7b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:15.273642 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a5761748-2bb4-4046-bb97-d2ef7ee88f7b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1218 microversion: 2.1 time: 0.117021 Aug 05 10:28:15.274254 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 168/340] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:15 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:15.856731 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-cf045f9f-94fe-457d-8b9b-806a98e26ba7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:15.857390 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-cf045f9f-94fe-457d-8b9b-806a98e26ba7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:15.863655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cf045f9f-94fe-457d-8b9b-806a98e26ba7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:15.864133 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cf045f9f-94fe-457d-8b9b-806a98e26ba7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:15.864560 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cf045f9f-94fe-457d-8b9b-806a98e26ba7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:15.865253 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cf045f9f-94fe-457d-8b9b-806a98e26ba7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:15.865700 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cf045f9f-94fe-457d-8b9b-806a98e26ba7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:15.866119 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cf045f9f-94fe-457d-8b9b-806a98e26ba7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:16.001721 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-cf045f9f-94fe-457d-8b9b-806a98e26ba7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:16.009523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-cf045f9f-94fe-457d-8b9b-806a98e26ba7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.157592 Aug 05 10:28:16.010052 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 173/341] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:15 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:16.037956 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d36d4a1c-ffc5-482a-bc9e-956508d1d1cd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:16.038551 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d36d4a1c-ffc5-482a-bc9e-956508d1d1cd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:16.045408 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d36d4a1c-ffc5-482a-bc9e-956508d1d1cd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:16.045924 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d36d4a1c-ffc5-482a-bc9e-956508d1d1cd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:16.046359 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d36d4a1c-ffc5-482a-bc9e-956508d1d1cd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:16.047085 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d36d4a1c-ffc5-482a-bc9e-956508d1d1cd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:16.047538 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d36d4a1c-ffc5-482a-bc9e-956508d1d1cd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:16.047960 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d36d4a1c-ffc5-482a-bc9e-956508d1d1cd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:16.194277 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d36d4a1c-ffc5-482a-bc9e-956508d1d1cd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:16.202612 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d36d4a1c-ffc5-482a-bc9e-956508d1d1cd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.169299 Aug 05 10:28:16.203634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 169/342] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:16 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:16.295004 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-60f2795c-9f5f-4f28-a66e-97ebf183ea85 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:16.295618 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-60f2795c-9f5f-4f28-a66e-97ebf183ea85 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:16.302123 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-60f2795c-9f5f-4f28-a66e-97ebf183ea85 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:16.302607 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-60f2795c-9f5f-4f28-a66e-97ebf183ea85 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:16.303074 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-60f2795c-9f5f-4f28-a66e-97ebf183ea85 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:16.303763 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-60f2795c-9f5f-4f28-a66e-97ebf183ea85 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:16.304217 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-60f2795c-9f5f-4f28-a66e-97ebf183ea85 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:16.304644 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-60f2795c-9f5f-4f28-a66e-97ebf183ea85 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:16.370414 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-60f2795c-9f5f-4f28-a66e-97ebf183ea85 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:16.379270 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-60f2795c-9f5f-4f28-a66e-97ebf183ea85 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1218 microversion: 2.1 time: 0.088219 Aug 05 10:28:16.379877 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 174/343] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:16 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:17.035315 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1a5efbc6-9598-41fd-a88e-2b1c3561a22c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:17.036337 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1a5efbc6-9598-41fd-a88e-2b1c3561a22c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:17.047383 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1a5efbc6-9598-41fd-a88e-2b1c3561a22c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:17.048464 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1a5efbc6-9598-41fd-a88e-2b1c3561a22c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:17.048806 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1a5efbc6-9598-41fd-a88e-2b1c3561a22c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:17.049999 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1a5efbc6-9598-41fd-a88e-2b1c3561a22c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:17.050741 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1a5efbc6-9598-41fd-a88e-2b1c3561a22c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:17.051481 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1a5efbc6-9598-41fd-a88e-2b1c3561a22c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:17.193469 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1a5efbc6-9598-41fd-a88e-2b1c3561a22c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:17.201217 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1a5efbc6-9598-41fd-a88e-2b1c3561a22c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.172893 Aug 05 10:28:17.201742 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 170/344] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:17 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:17.224669 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f394f7a6-810b-42e6-a202-f8c704af143a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:17.226069 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f394f7a6-810b-42e6-a202-f8c704af143a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:17.232795 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f394f7a6-810b-42e6-a202-f8c704af143a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:17.233409 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f394f7a6-810b-42e6-a202-f8c704af143a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:17.234380 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f394f7a6-810b-42e6-a202-f8c704af143a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:17.235260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f394f7a6-810b-42e6-a202-f8c704af143a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:17.235709 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f394f7a6-810b-42e6-a202-f8c704af143a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:17.236324 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f394f7a6-810b-42e6-a202-f8c704af143a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:17.256763 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=100 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:28:17.384995 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-f394f7a6-810b-42e6-a202-f8c704af143a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:17.393151 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f394f7a6-810b-42e6-a202-f8c704af143a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.172253 Aug 05 10:28:17.393721 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 175/345] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:17 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:17.401434 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e26cc388-3e38-453d-9641-647db7749bcd tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:17.402266 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e26cc388-3e38-453d-9641-647db7749bcd tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:17.409370 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e26cc388-3e38-453d-9641-647db7749bcd tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:17.410232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e26cc388-3e38-453d-9641-647db7749bcd tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:17.410733 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e26cc388-3e38-453d-9641-647db7749bcd tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:17.411973 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e26cc388-3e38-453d-9641-647db7749bcd tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:17.412642 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e26cc388-3e38-453d-9641-647db7749bcd tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:17.413240 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e26cc388-3e38-453d-9641-647db7749bcd tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:17.485423 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e26cc388-3e38-453d-9641-647db7749bcd tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:17.493927 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e26cc388-3e38-453d-9641-647db7749bcd tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1218 microversion: 2.1 time: 0.096305 Aug 05 10:28:17.501093 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 171/346] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:17 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:18.221741 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-384b3389-8ef6-4ad2-b2b9-544bafdbc8c3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:18.222351 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-384b3389-8ef6-4ad2-b2b9-544bafdbc8c3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:18.228269 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-384b3389-8ef6-4ad2-b2b9-544bafdbc8c3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:18.228904 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-384b3389-8ef6-4ad2-b2b9-544bafdbc8c3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:18.229163 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-384b3389-8ef6-4ad2-b2b9-544bafdbc8c3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:18.230582 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-384b3389-8ef6-4ad2-b2b9-544bafdbc8c3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:18.231071 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-384b3389-8ef6-4ad2-b2b9-544bafdbc8c3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:18.231495 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-384b3389-8ef6-4ad2-b2b9-544bafdbc8c3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:18.414168 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c69a744f-e6ab-45b9-94ea-453dd057d24e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:18.414915 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c69a744f-e6ab-45b9-94ea-453dd057d24e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:18.416022 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-384b3389-8ef6-4ad2-b2b9-544bafdbc8c3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:18.417786 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:28:18.423409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c69a744f-e6ab-45b9-94ea-453dd057d24e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:18.424089 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c69a744f-e6ab-45b9-94ea-453dd057d24e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:18.424238 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-384b3389-8ef6-4ad2-b2b9-544bafdbc8c3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.206319 Aug 05 10:28:18.424525 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c69a744f-e6ab-45b9-94ea-453dd057d24e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:18.430934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 176/347] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:18 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:18.431098 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c69a744f-e6ab-45b9-94ea-453dd057d24e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:18.431098 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c69a744f-e6ab-45b9-94ea-453dd057d24e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:18.431098 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c69a744f-e6ab-45b9-94ea-453dd057d24e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:18.498058 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=8 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:28:18.515705 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-aee5574e-4d7b-43d6-9bcb-99a51aa09fa6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:18.516312 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-aee5574e-4d7b-43d6-9bcb-99a51aa09fa6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:18.522470 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aee5574e-4d7b-43d6-9bcb-99a51aa09fa6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:18.522984 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aee5574e-4d7b-43d6-9bcb-99a51aa09fa6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:18.523421 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aee5574e-4d7b-43d6-9bcb-99a51aa09fa6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:18.524107 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aee5574e-4d7b-43d6-9bcb-99a51aa09fa6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:18.524554 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aee5574e-4d7b-43d6-9bcb-99a51aa09fa6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:18.524969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aee5574e-4d7b-43d6-9bcb-99a51aa09fa6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:18.563835 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c69a744f-e6ab-45b9-94ea-453dd057d24e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:18.572833 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c69a744f-e6ab-45b9-94ea-453dd057d24e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.162939 Aug 05 10:28:18.573443 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 172/348] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:18 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:28:18.605726 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-aee5574e-4d7b-43d6-9bcb-99a51aa09fa6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:18.613402 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-aee5574e-4d7b-43d6-9bcb-99a51aa09fa6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1218 microversion: 2.1 time: 0.102314 Aug 05 10:28:18.613968 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 177/349] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:18 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:28:19.445688 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8a65dbc8-c538-4ba6-9a12-f0f2f9a31947 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:19.446477 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8a65dbc8-c538-4ba6-9a12-f0f2f9a31947 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:19.453685 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a65dbc8-c538-4ba6-9a12-f0f2f9a31947 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:19.454359 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a65dbc8-c538-4ba6-9a12-f0f2f9a31947 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:19.454791 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a65dbc8-c538-4ba6-9a12-f0f2f9a31947 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:19.455512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a65dbc8-c538-4ba6-9a12-f0f2f9a31947 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:19.455953 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a65dbc8-c538-4ba6-9a12-f0f2f9a31947 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:19.456364 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a65dbc8-c538-4ba6-9a12-f0f2f9a31947 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:19.594403 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-2972e022-58ab-41d2-bcd2-cf223c0614f3 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:19.595138 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-2972e022-58ab-41d2-bcd2-cf223c0614f3 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:19.601311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2972e022-58ab-41d2-bcd2-cf223c0614f3 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:19.601926 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2972e022-58ab-41d2-bcd2-cf223c0614f3 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:19.602421 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2972e022-58ab-41d2-bcd2-cf223c0614f3 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:19.603282 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2972e022-58ab-41d2-bcd2-cf223c0614f3 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:19.603858 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2972e022-58ab-41d2-bcd2-cf223c0614f3 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:19.604341 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2972e022-58ab-41d2-bcd2-cf223c0614f3 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:19.606273 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8a65dbc8-c538-4ba6-9a12-f0f2f9a31947 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:19.614445 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8a65dbc8-c538-4ba6-9a12-f0f2f9a31947 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.172655 Aug 05 10:28:19.615231 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 173/350] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:19 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:19.633644 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-55b135d7-0f7a-48c1-b3c8-1137c9d1f585 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:19.634251 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-55b135d7-0f7a-48c1-b3c8-1137c9d1f585 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:19.640521 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-55b135d7-0f7a-48c1-b3c8-1137c9d1f585 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:19.640937 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-55b135d7-0f7a-48c1-b3c8-1137c9d1f585 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:19.641375 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-55b135d7-0f7a-48c1-b3c8-1137c9d1f585 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:19.642073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-55b135d7-0f7a-48c1-b3c8-1137c9d1f585 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:19.642531 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-55b135d7-0f7a-48c1-b3c8-1137c9d1f585 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:19.642983 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-55b135d7-0f7a-48c1-b3c8-1137c9d1f585 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:19.708587 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-55b135d7-0f7a-48c1-b3c8-1137c9d1f585 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:19.716297 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-55b135d7-0f7a-48c1-b3c8-1137c9d1f585 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1218 microversion: 2.1 time: 0.086548 Aug 05 10:28:19.716869 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 174/351] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:19 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:28:19.740086 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2972e022-58ab-41d2-bcd2-cf223c0614f3 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:19.751449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-2972e022-58ab-41d2-bcd2-cf223c0614f3 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.161579 Aug 05 10:28:19.752284 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 178/352] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:19 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:20.635912 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7c8e7c1a-a1c6-4812-9ca1-bafdfed1ebf3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:20.636510 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7c8e7c1a-a1c6-4812-9ca1-bafdfed1ebf3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:20.643652 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c8e7c1a-a1c6-4812-9ca1-bafdfed1ebf3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:20.644106 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c8e7c1a-a1c6-4812-9ca1-bafdfed1ebf3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:20.644530 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c8e7c1a-a1c6-4812-9ca1-bafdfed1ebf3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:20.645216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c8e7c1a-a1c6-4812-9ca1-bafdfed1ebf3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:20.645656 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c8e7c1a-a1c6-4812-9ca1-bafdfed1ebf3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:20.646070 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c8e7c1a-a1c6-4812-9ca1-bafdfed1ebf3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:20.737178 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-4506b741-05de-41f9-8b12-f74acdd52ab0 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:20.737972 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-4506b741-05de-41f9-8b12-f74acdd52ab0 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:20.744773 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4506b741-05de-41f9-8b12-f74acdd52ab0 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:20.745337 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4506b741-05de-41f9-8b12-f74acdd52ab0 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:20.745774 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4506b741-05de-41f9-8b12-f74acdd52ab0 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:20.746476 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4506b741-05de-41f9-8b12-f74acdd52ab0 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:20.747064 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4506b741-05de-41f9-8b12-f74acdd52ab0 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:20.747482 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4506b741-05de-41f9-8b12-f74acdd52ab0 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:20.842385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7c8e7c1a-a1c6-4812-9ca1-bafdfed1ebf3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:20.848904 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-4506b741-05de-41f9-8b12-f74acdd52ab0 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:20.856187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7c8e7c1a-a1c6-4812-9ca1-bafdfed1ebf3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.224004 Aug 05 10:28:20.860257 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-4506b741-05de-41f9-8b12-f74acdd52ab0 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1218 microversion: 2.1 time: 0.127152 Aug 05 10:28:20.861345 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 179/354] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:20 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1218 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:20.861470 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 175/354] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:20 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:20.873787 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9280553f-ec88-45d7-8ef6-3a98662b7759 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:20.874597 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9280553f-ec88-45d7-8ef6-3a98662b7759 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:20.890003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9280553f-ec88-45d7-8ef6-3a98662b7759 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:20.891462 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9280553f-ec88-45d7-8ef6-3a98662b7759 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:20.891896 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9280553f-ec88-45d7-8ef6-3a98662b7759 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:20.892602 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9280553f-ec88-45d7-8ef6-3a98662b7759 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:20.893048 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9280553f-ec88-45d7-8ef6-3a98662b7759 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:20.893546 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9280553f-ec88-45d7-8ef6-3a98662b7759 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:21.067443 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9280553f-ec88-45d7-8ef6-3a98662b7759 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:21.076059 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9280553f-ec88-45d7-8ef6-3a98662b7759 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.213328 Aug 05 10:28:21.079024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 176/355] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:20 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:21.479182 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-b9891ded-c48c-4656-8c1a-4f73168c85b9 req-f45f58cf-72b5-496f-b612-e82da18c3ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08e86ee6-2452-4827-aff1-651395a4a8dc", "tag": "281bc44c-dd54-4a8e-b7a3-049f2bdcf803"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:28:21.489940 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-b9891ded-c48c-4656-8c1a-4f73168c85b9 req-f45f58cf-72b5-496f-b612-e82da18c3ab6 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:21.490768 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-b9891ded-c48c-4656-8c1a-4f73168c85b9 req-f45f58cf-72b5-496f-b612-e82da18c3ab6 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:21.491446 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-b9891ded-c48c-4656-8c1a-4f73168c85b9 req-f45f58cf-72b5-496f-b612-e82da18c3ab6 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:21.504883 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-b9891ded-c48c-4656-8c1a-4f73168c85b9 req-f45f58cf-72b5-496f-b612-e82da18c3ab6 service nova] Creating event network-changed:281bc44c-dd54-4a8e-b7a3-049f2bdcf803 for instance 08e86ee6-2452-4827-aff1-651395a4a8dc on hv-cinder-81558 Aug 05 10:28:21.510243 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-b9891ded-c48c-4656-8c1a-4f73168c85b9 req-f45f58cf-72b5-496f-b612-e82da18c3ab6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041181 Aug 05 10:28:21.510811 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 180/356] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:28:21.880116 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2d787b7e-2cee-4a0f-8dce-059f0f611f40 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:21.881394 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2d787b7e-2cee-4a0f-8dce-059f0f611f40 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:21.881950 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-a107374f-b63c-4f47-9f00-fa3ac92f2ab4 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:21.883304 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:28:21.883812 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-a107374f-b63c-4f47-9f00-fa3ac92f2ab4 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:21.889855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d787b7e-2cee-4a0f-8dce-059f0f611f40 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:21.890609 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d787b7e-2cee-4a0f-8dce-059f0f611f40 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:21.891075 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d787b7e-2cee-4a0f-8dce-059f0f611f40 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:21.891541 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a107374f-b63c-4f47-9f00-fa3ac92f2ab4 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:21.891789 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d787b7e-2cee-4a0f-8dce-059f0f611f40 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:21.892319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a107374f-b63c-4f47-9f00-fa3ac92f2ab4 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:21.892443 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d787b7e-2cee-4a0f-8dce-059f0f611f40 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:21.892753 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a107374f-b63c-4f47-9f00-fa3ac92f2ab4 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:21.892863 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d787b7e-2cee-4a0f-8dce-059f0f611f40 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:21.893436 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a107374f-b63c-4f47-9f00-fa3ac92f2ab4 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:21.894055 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a107374f-b63c-4f47-9f00-fa3ac92f2ab4 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:21.894508 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a107374f-b63c-4f47-9f00-fa3ac92f2ab4 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:22.007645 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a107374f-b63c-4f47-9f00-fa3ac92f2ab4 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:22.015953 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-a107374f-b63c-4f47-9f00-fa3ac92f2ab4 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1284 microversion: 2.1 time: 0.138373 Aug 05 10:28:22.027808 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 181/357] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:21 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:22.061734 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2d787b7e-2cee-4a0f-8dce-059f0f611f40 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:22.069651 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2d787b7e-2cee-4a0f-8dce-059f0f611f40 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.193886 Aug 05 10:28:22.070206 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 177/358] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:21 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:22.096926 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-61d23d70-709e-44af-8154-c12eea5a299c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:22.097563 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-61d23d70-709e-44af-8154-c12eea5a299c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:22.103485 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-61d23d70-709e-44af-8154-c12eea5a299c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:22.103964 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-61d23d70-709e-44af-8154-c12eea5a299c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:22.104398 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-61d23d70-709e-44af-8154-c12eea5a299c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:22.105090 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-61d23d70-709e-44af-8154-c12eea5a299c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:22.105544 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-61d23d70-709e-44af-8154-c12eea5a299c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:22.106094 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-61d23d70-709e-44af-8154-c12eea5a299c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:22.244263 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-61d23d70-709e-44af-8154-c12eea5a299c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:22.252325 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-61d23d70-709e-44af-8154-c12eea5a299c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.159345 Aug 05 10:28:22.253026 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 182/359] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:22 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:23.037371 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b80c1b81-75dc-47c5-8cbd-b14f406fdd48 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:23.038225 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b80c1b81-75dc-47c5-8cbd-b14f406fdd48 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:23.045428 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b80c1b81-75dc-47c5-8cbd-b14f406fdd48 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:23.046027 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b80c1b81-75dc-47c5-8cbd-b14f406fdd48 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:23.046536 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b80c1b81-75dc-47c5-8cbd-b14f406fdd48 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:23.047635 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b80c1b81-75dc-47c5-8cbd-b14f406fdd48 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:23.048194 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b80c1b81-75dc-47c5-8cbd-b14f406fdd48 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:23.048691 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b80c1b81-75dc-47c5-8cbd-b14f406fdd48 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:23.089496 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-01248a0e-8c1e-40ae-8b21-2e4de2f72f09 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:23.090099 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-01248a0e-8c1e-40ae-8b21-2e4de2f72f09 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:23.096577 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-01248a0e-8c1e-40ae-8b21-2e4de2f72f09 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:23.097057 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-01248a0e-8c1e-40ae-8b21-2e4de2f72f09 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:23.097493 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-01248a0e-8c1e-40ae-8b21-2e4de2f72f09 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:23.098190 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-01248a0e-8c1e-40ae-8b21-2e4de2f72f09 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:23.098640 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-01248a0e-8c1e-40ae-8b21-2e4de2f72f09 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:23.099091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-01248a0e-8c1e-40ae-8b21-2e4de2f72f09 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:23.147950 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b80c1b81-75dc-47c5-8cbd-b14f406fdd48 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:23.157156 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b80c1b81-75dc-47c5-8cbd-b14f406fdd48 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1284 microversion: 2.1 time: 0.124199 Aug 05 10:28:23.169244 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 178/360] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:23 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:23.260904 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-01248a0e-8c1e-40ae-8b21-2e4de2f72f09 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:23.271536 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-01248a0e-8c1e-40ae-8b21-2e4de2f72f09 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.185615 Aug 05 10:28:23.272279 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 183/361] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:23 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:28:23.274513 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6da80606-3834-4421-9323-8111f0f84e77 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:23.275327 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6da80606-3834-4421-9323-8111f0f84e77 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:23.282110 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6da80606-3834-4421-9323-8111f0f84e77 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:23.282609 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6da80606-3834-4421-9323-8111f0f84e77 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:23.283072 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6da80606-3834-4421-9323-8111f0f84e77 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:23.283781 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6da80606-3834-4421-9323-8111f0f84e77 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:23.284744 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6da80606-3834-4421-9323-8111f0f84e77 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:23.285379 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6da80606-3834-4421-9323-8111f0f84e77 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:23.473387 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6da80606-3834-4421-9323-8111f0f84e77 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:23.482330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6da80606-3834-4421-9323-8111f0f84e77 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.212415 Aug 05 10:28:23.483155 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 179/362] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:23 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:24.181791 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-53718db3-9a0c-4552-8a28-ee4974ff55b6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:24.182405 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-53718db3-9a0c-4552-8a28-ee4974ff55b6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:24.189239 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-53718db3-9a0c-4552-8a28-ee4974ff55b6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:24.189729 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-53718db3-9a0c-4552-8a28-ee4974ff55b6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:24.190376 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-53718db3-9a0c-4552-8a28-ee4974ff55b6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:24.191012 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-53718db3-9a0c-4552-8a28-ee4974ff55b6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:24.191486 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-53718db3-9a0c-4552-8a28-ee4974ff55b6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:24.191926 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-53718db3-9a0c-4552-8a28-ee4974ff55b6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:24.294284 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4c4f1819-b8eb-4f58-8b2b-b3ed4f14ffff tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:24.295571 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4c4f1819-b8eb-4f58-8b2b-b3ed4f14ffff tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:24.301940 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4c4f1819-b8eb-4f58-8b2b-b3ed4f14ffff tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:24.302430 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4c4f1819-b8eb-4f58-8b2b-b3ed4f14ffff tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:24.302941 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4c4f1819-b8eb-4f58-8b2b-b3ed4f14ffff tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:24.303796 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4c4f1819-b8eb-4f58-8b2b-b3ed4f14ffff tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:24.304319 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4c4f1819-b8eb-4f58-8b2b-b3ed4f14ffff tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:24.304811 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4c4f1819-b8eb-4f58-8b2b-b3ed4f14ffff tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:24.445896 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4c4f1819-b8eb-4f58-8b2b-b3ed4f14ffff tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:24.453522 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4c4f1819-b8eb-4f58-8b2b-b3ed4f14ffff tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.163224 Aug 05 10:28:24.454098 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 180/363] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:24 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:24.463945 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-53718db3-9a0c-4552-8a28-ee4974ff55b6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:24.472795 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-53718db3-9a0c-4552-8a28-ee4974ff55b6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1314 microversion: 2.1 time: 0.294873 Aug 05 10:28:24.473590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 184/364] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:24 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:24.503164 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f7750e3b-a92b-4e46-9202-cc6c5d88e912 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:24.503779 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f7750e3b-a92b-4e46-9202-cc6c5d88e912 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:24.510742 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7750e3b-a92b-4e46-9202-cc6c5d88e912 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:24.511293 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7750e3b-a92b-4e46-9202-cc6c5d88e912 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:24.511733 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7750e3b-a92b-4e46-9202-cc6c5d88e912 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:24.512429 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7750e3b-a92b-4e46-9202-cc6c5d88e912 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:24.512882 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7750e3b-a92b-4e46-9202-cc6c5d88e912 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:24.513310 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7750e3b-a92b-4e46-9202-cc6c5d88e912 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:24.649260 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f7750e3b-a92b-4e46-9202-cc6c5d88e912 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:24.660500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f7750e3b-a92b-4e46-9202-cc6c5d88e912 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1520 microversion: 2.1 time: 0.159960 Aug 05 10:28:24.661508 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 181/365] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:24 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:24.998523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-bd80b726-7882-4c6a-b2fe-e72648bd7f36 req-c3926c0c-e37d-4c6e-a52f-678d42bbcba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4", "tag": "66779bc6-3193-4b1c-9bbc-d146c205fa42"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:28:25.010952 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-bd80b726-7882-4c6a-b2fe-e72648bd7f36 req-c3926c0c-e37d-4c6e-a52f-678d42bbcba0 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:25.011604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-bd80b726-7882-4c6a-b2fe-e72648bd7f36 req-c3926c0c-e37d-4c6e-a52f-678d42bbcba0 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:25.012004 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-bd80b726-7882-4c6a-b2fe-e72648bd7f36 req-c3926c0c-e37d-4c6e-a52f-678d42bbcba0 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:25.030710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-bd80b726-7882-4c6a-b2fe-e72648bd7f36 req-c3926c0c-e37d-4c6e-a52f-678d42bbcba0 service nova] Creating event network-changed:66779bc6-3193-4b1c-9bbc-d146c205fa42 for instance 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 on hv-cinder-81558 Aug 05 10:28:25.038035 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-bd80b726-7882-4c6a-b2fe-e72648bd7f36 req-c3926c0c-e37d-4c6e-a52f-678d42bbcba0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044354 Aug 05 10:28:25.039456 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 185/366] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:28:25.476317 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-aac23308-da0a-4a7f-825d-1b8dc1f59c9a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:25.476911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-aac23308-da0a-4a7f-825d-1b8dc1f59c9a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:25.485525 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aac23308-da0a-4a7f-825d-1b8dc1f59c9a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:25.486005 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aac23308-da0a-4a7f-825d-1b8dc1f59c9a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:25.486448 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aac23308-da0a-4a7f-825d-1b8dc1f59c9a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:25.487444 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aac23308-da0a-4a7f-825d-1b8dc1f59c9a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:25.487915 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aac23308-da0a-4a7f-825d-1b8dc1f59c9a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:25.488417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aac23308-da0a-4a7f-825d-1b8dc1f59c9a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:25.501745 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f874372f-19b6-4abe-84c8-144e51a2f04b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:25.502435 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f874372f-19b6-4abe-84c8-144e51a2f04b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:25.509328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f874372f-19b6-4abe-84c8-144e51a2f04b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:25.509815 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f874372f-19b6-4abe-84c8-144e51a2f04b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:25.510228 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f874372f-19b6-4abe-84c8-144e51a2f04b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:25.510964 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f874372f-19b6-4abe-84c8-144e51a2f04b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:25.511413 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f874372f-19b6-4abe-84c8-144e51a2f04b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:25.511824 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f874372f-19b6-4abe-84c8-144e51a2f04b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:25.632785 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-aac23308-da0a-4a7f-825d-1b8dc1f59c9a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:25.640947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-aac23308-da0a-4a7f-825d-1b8dc1f59c9a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.168430 Aug 05 10:28:25.641490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 182/367] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:25 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:25.661185 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-f874372f-19b6-4abe-84c8-144e51a2f04b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:25.668852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f874372f-19b6-4abe-84c8-144e51a2f04b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1314 microversion: 2.1 time: 0.171656 Aug 05 10:28:25.669445 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 186/368] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:25 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:25.681596 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6e692cf5-d459-4d6e-9a85-168017681587 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:25.682221 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6e692cf5-d459-4d6e-9a85-168017681587 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:25.689095 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6e692cf5-d459-4d6e-9a85-168017681587 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:25.689895 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6e692cf5-d459-4d6e-9a85-168017681587 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:25.690583 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6e692cf5-d459-4d6e-9a85-168017681587 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:25.691593 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6e692cf5-d459-4d6e-9a85-168017681587 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:25.692242 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6e692cf5-d459-4d6e-9a85-168017681587 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:25.692857 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6e692cf5-d459-4d6e-9a85-168017681587 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:25.840757 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6e692cf5-d459-4d6e-9a85-168017681587 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:25.848896 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6e692cf5-d459-4d6e-9a85-168017681587 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1500 microversion: 2.1 time: 0.171237 Aug 05 10:28:25.849509 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 183/369] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:25 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1500 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:25.869140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-3cb4818b-b3d8-4739-a9e8-0b15db5d4541 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:25.869742 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-3cb4818b-b3d8-4739-a9e8-0b15db5d4541 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:25.876325 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3cb4818b-b3d8-4739-a9e8-0b15db5d4541 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:25.876860 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3cb4818b-b3d8-4739-a9e8-0b15db5d4541 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:25.877295 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3cb4818b-b3d8-4739-a9e8-0b15db5d4541 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:25.877989 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3cb4818b-b3d8-4739-a9e8-0b15db5d4541 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:25.878436 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3cb4818b-b3d8-4739-a9e8-0b15db5d4541 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:25.878839 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3cb4818b-b3d8-4739-a9e8-0b15db5d4541 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:26.254601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-3cb4818b-b3d8-4739-a9e8-0b15db5d4541 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:26.266147 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-3cb4818b-b3d8-4739-a9e8-0b15db5d4541 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1516 microversion: 2.1 time: 0.400583 Aug 05 10:28:26.283408 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 187/370] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:25 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1516 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:26.668192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3ff08efb-8b8d-49cf-9821-0aefb5b11a88 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:26.668888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3ff08efb-8b8d-49cf-9821-0aefb5b11a88 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:26.676385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3ff08efb-8b8d-49cf-9821-0aefb5b11a88 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:26.677073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3ff08efb-8b8d-49cf-9821-0aefb5b11a88 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:26.677539 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3ff08efb-8b8d-49cf-9821-0aefb5b11a88 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:26.678257 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3ff08efb-8b8d-49cf-9821-0aefb5b11a88 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:26.679241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3ff08efb-8b8d-49cf-9821-0aefb5b11a88 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:26.679241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3ff08efb-8b8d-49cf-9821-0aefb5b11a88 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:26.689739 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ed03f037-0ce2-4045-8a7d-0f9ee8d7f5d8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:26.690352 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-ed03f037-0ce2-4045-8a7d-0f9ee8d7f5d8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:26.696758 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ed03f037-0ce2-4045-8a7d-0f9ee8d7f5d8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:26.697272 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ed03f037-0ce2-4045-8a7d-0f9ee8d7f5d8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:26.697643 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ed03f037-0ce2-4045-8a7d-0f9ee8d7f5d8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:26.698522 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ed03f037-0ce2-4045-8a7d-0f9ee8d7f5d8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:26.699010 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ed03f037-0ce2-4045-8a7d-0f9ee8d7f5d8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:26.699516 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ed03f037-0ce2-4045-8a7d-0f9ee8d7f5d8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:26.699785 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:28:26.816626 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3ff08efb-8b8d-49cf-9821-0aefb5b11a88 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:26.824112 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3ff08efb-8b8d-49cf-9821-0aefb5b11a88 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.159863 Aug 05 10:28:26.824762 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 184/371] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:26 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:28:26.830851 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ed03f037-0ce2-4045-8a7d-0f9ee8d7f5d8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:26.838514 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ed03f037-0ce2-4045-8a7d-0f9ee8d7f5d8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1314 microversion: 2.1 time: 0.152774 Aug 05 10:28:26.839091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 188/372] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:26 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:28:27.671276 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-14f2ae48-1862-45fe-8273-f38fe9f377c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:28:27.675500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-14f2ae48-1862-45fe-8273-f38fe9f377c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:27.684000 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-14f2ae48-1862-45fe-8273-f38fe9f377c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:27.684539 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-14f2ae48-1862-45fe-8273-f38fe9f377c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:27.684973 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-14f2ae48-1862-45fe-8273-f38fe9f377c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:27.685715 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-14f2ae48-1862-45fe-8273-f38fe9f377c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:27.686675 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-14f2ae48-1862-45fe-8273-f38fe9f377c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:27.686861 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-14f2ae48-1862-45fe-8273-f38fe9f377c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:27.710552 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-14f2ae48-1862-45fe-8273-f38fe9f377c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lazy-loading 'flavor' on Instance uuid 5ffbb1e1-7319-4e06-8218-45198955c4fc {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:28:27.828864 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-14f2ae48-1862-45fe-8273-f38fe9f377c8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "POST /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc/action" status: 200 len: 32 microversion: 2.1 time: 0.161635 Aug 05 10:28:27.829455 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 185/373] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 10:28:27 2022] POST /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 10:28:27.839484 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-df869e75-8cf7-451e-89ec-4cb4b676db4a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:27.840361 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-df869e75-8cf7-451e-89ec-4cb4b676db4a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:27.844851 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2fa7db57-8bdd-483e-af7c-d4b7857ac4e7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:27.845629 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2fa7db57-8bdd-483e-af7c-d4b7857ac4e7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:27.848254 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-df869e75-8cf7-451e-89ec-4cb4b676db4a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:27.848744 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-df869e75-8cf7-451e-89ec-4cb4b676db4a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:27.849170 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-df869e75-8cf7-451e-89ec-4cb4b676db4a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:27.849860 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-df869e75-8cf7-451e-89ec-4cb4b676db4a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:27.850303 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-df869e75-8cf7-451e-89ec-4cb4b676db4a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:27.850719 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-df869e75-8cf7-451e-89ec-4cb4b676db4a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:27.852022 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2fa7db57-8bdd-483e-af7c-d4b7857ac4e7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:27.852502 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2fa7db57-8bdd-483e-af7c-d4b7857ac4e7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:27.852925 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2fa7db57-8bdd-483e-af7c-d4b7857ac4e7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:27.853716 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2fa7db57-8bdd-483e-af7c-d4b7857ac4e7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:27.854194 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2fa7db57-8bdd-483e-af7c-d4b7857ac4e7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:27.854617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2fa7db57-8bdd-483e-af7c-d4b7857ac4e7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:27.993365 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-df869e75-8cf7-451e-89ec-4cb4b676db4a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:28.002080 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-df869e75-8cf7-451e-89ec-4cb4b676db4a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1522 microversion: 2.1 time: 0.166840 Aug 05 10:28:28.002659 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 189/374] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:27 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:28.007345 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-5c597734-1365-48c3-8843-dea7a6ab5472 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:28.010265 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-5c597734-1365-48c3-8843-dea7a6ab5472 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:28.017317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5c597734-1365-48c3-8843-dea7a6ab5472 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:28.017907 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5c597734-1365-48c3-8843-dea7a6ab5472 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:28.018417 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5c597734-1365-48c3-8843-dea7a6ab5472 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:28.019219 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5c597734-1365-48c3-8843-dea7a6ab5472 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:28.019741 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5c597734-1365-48c3-8843-dea7a6ab5472 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:28.020256 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5c597734-1365-48c3-8843-dea7a6ab5472 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:28.168264 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-5c597734-1365-48c3-8843-dea7a6ab5472 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:28.176320 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-5c597734-1365-48c3-8843-dea7a6ab5472 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1314 microversion: 2.1 time: 0.172575 Aug 05 10:28:28.176859 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 190/375] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:28 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:28.226502 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2fa7db57-8bdd-483e-af7c-d4b7857ac4e7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:28.235475 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2fa7db57-8bdd-483e-af7c-d4b7857ac4e7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.395100 Aug 05 10:28:28.236019 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 186/376] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:27 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:28:29.035016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d7709945-6836-4e35-8996-f155712989f9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:29.036091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d7709945-6836-4e35-8996-f155712989f9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:29.039425 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=70 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:28:29.048234 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d7709945-6836-4e35-8996-f155712989f9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:29.048702 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d7709945-6836-4e35-8996-f155712989f9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:29.049133 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d7709945-6836-4e35-8996-f155712989f9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:29.049828 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d7709945-6836-4e35-8996-f155712989f9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:29.050309 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d7709945-6836-4e35-8996-f155712989f9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:29.050731 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d7709945-6836-4e35-8996-f155712989f9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:29.196814 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d7709945-6836-4e35-8996-f155712989f9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:29.196997 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-982b729c-85b8-4cbb-96b9-35dd4de578cf tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:29.197441 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-982b729c-85b8-4cbb-96b9-35dd4de578cf tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:29.204443 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-982b729c-85b8-4cbb-96b9-35dd4de578cf tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:29.204835 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-982b729c-85b8-4cbb-96b9-35dd4de578cf tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:29.205141 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d7709945-6836-4e35-8996-f155712989f9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1522 microversion: 2.1 time: 0.177814 Aug 05 10:28:29.205253 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-982b729c-85b8-4cbb-96b9-35dd4de578cf tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:29.205717 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 191/377] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:29 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:29.205918 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-982b729c-85b8-4cbb-96b9-35dd4de578cf tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:29.206368 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-982b729c-85b8-4cbb-96b9-35dd4de578cf tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:29.206780 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-982b729c-85b8-4cbb-96b9-35dd4de578cf tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:29.259192 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c80d115a-361b-4855-b1d3-f94bd4c4298a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:29.260034 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c80d115a-361b-4855-b1d3-f94bd4c4298a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:29.269432 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c80d115a-361b-4855-b1d3-f94bd4c4298a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:29.270118 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c80d115a-361b-4855-b1d3-f94bd4c4298a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:29.270784 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c80d115a-361b-4855-b1d3-f94bd4c4298a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:29.271844 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c80d115a-361b-4855-b1d3-f94bd4c4298a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:29.272505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c80d115a-361b-4855-b1d3-f94bd4c4298a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:29.273141 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c80d115a-361b-4855-b1d3-f94bd4c4298a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:29.351442 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-982b729c-85b8-4cbb-96b9-35dd4de578cf tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:29.359310 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-982b729c-85b8-4cbb-96b9-35dd4de578cf tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1314 microversion: 2.1 time: 0.166242 Aug 05 10:28:29.360493 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 187/378] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:29 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:29.409138 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c80d115a-361b-4855-b1d3-f94bd4c4298a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:29.417008 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c80d115a-361b-4855-b1d3-f94bd4c4298a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.164014 Aug 05 10:28:29.417497 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 192/379] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:29 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:30.229200 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4005276f-ea74-440a-b815-767f27a41f9b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:30.230059 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4005276f-ea74-440a-b815-767f27a41f9b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:30.238490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4005276f-ea74-440a-b815-767f27a41f9b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:30.239006 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4005276f-ea74-440a-b815-767f27a41f9b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:30.239438 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4005276f-ea74-440a-b815-767f27a41f9b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:30.240223 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4005276f-ea74-440a-b815-767f27a41f9b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:30.240666 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4005276f-ea74-440a-b815-767f27a41f9b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:30.241095 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4005276f-ea74-440a-b815-767f27a41f9b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:30.381485 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ea4d2ab0-f16c-4d5e-8cb8-3608cc048c92 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:30.382835 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-ea4d2ab0-f16c-4d5e-8cb8-3608cc048c92 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:30.389072 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4005276f-ea74-440a-b815-767f27a41f9b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:30.396324 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ea4d2ab0-f16c-4d5e-8cb8-3608cc048c92 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:30.396949 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ea4d2ab0-f16c-4d5e-8cb8-3608cc048c92 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:30.397390 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ea4d2ab0-f16c-4d5e-8cb8-3608cc048c92 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:30.398079 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ea4d2ab0-f16c-4d5e-8cb8-3608cc048c92 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:30.398223 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4005276f-ea74-440a-b815-767f27a41f9b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1522 microversion: 2.1 time: 0.174542 Aug 05 10:28:30.398614 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ea4d2ab0-f16c-4d5e-8cb8-3608cc048c92 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:30.399044 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ea4d2ab0-f16c-4d5e-8cb8-3608cc048c92 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:30.399180 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 188/380] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:30 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:30.421853 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=100 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:28:30.437958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b0901bcf-4605-4c61-a392-cf8428975d86 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:30.438856 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b0901bcf-4605-4c61-a392-cf8428975d86 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:30.447506 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b0901bcf-4605-4c61-a392-cf8428975d86 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:30.447998 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b0901bcf-4605-4c61-a392-cf8428975d86 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:30.448432 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b0901bcf-4605-4c61-a392-cf8428975d86 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:30.449136 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b0901bcf-4605-4c61-a392-cf8428975d86 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:30.449938 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b0901bcf-4605-4c61-a392-cf8428975d86 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:30.450033 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b0901bcf-4605-4c61-a392-cf8428975d86 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:30.595180 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b0901bcf-4605-4c61-a392-cf8428975d86 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:30.603056 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b0901bcf-4605-4c61-a392-cf8428975d86 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.169156 Aug 05 10:28:30.603554 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 189/381] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:30 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:28:30.727091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ea4d2ab0-f16c-4d5e-8cb8-3608cc048c92 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:30.734827 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ea4d2ab0-f16c-4d5e-8cb8-3608cc048c92 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1314 microversion: 2.1 time: 0.357424 Aug 05 10:28:30.735801 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 193/382] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:30 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:31.421716 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dc3dd5a0-19de-48d9-b946-641247c1ba0a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:31.422273 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dc3dd5a0-19de-48d9-b946-641247c1ba0a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:31.429528 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc3dd5a0-19de-48d9-b946-641247c1ba0a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:31.429986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc3dd5a0-19de-48d9-b946-641247c1ba0a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:31.430434 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc3dd5a0-19de-48d9-b946-641247c1ba0a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:31.431164 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc3dd5a0-19de-48d9-b946-641247c1ba0a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:31.431611 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc3dd5a0-19de-48d9-b946-641247c1ba0a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:31.432008 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc3dd5a0-19de-48d9-b946-641247c1ba0a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:31.574487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dc3dd5a0-19de-48d9-b946-641247c1ba0a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:31.583233 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dc3dd5a0-19de-48d9-b946-641247c1ba0a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1522 microversion: 2.1 time: 0.165388 Aug 05 10:28:31.584459 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 190/383] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:31 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:31.625712 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-923bb3c0-2909-4195-ba10-00ac932d611c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:31.626851 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-923bb3c0-2909-4195-ba10-00ac932d611c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:31.632932 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-923bb3c0-2909-4195-ba10-00ac932d611c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:31.633417 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-923bb3c0-2909-4195-ba10-00ac932d611c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:31.633918 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-923bb3c0-2909-4195-ba10-00ac932d611c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:31.634862 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-923bb3c0-2909-4195-ba10-00ac932d611c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:31.635363 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-923bb3c0-2909-4195-ba10-00ac932d611c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:31.635850 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-923bb3c0-2909-4195-ba10-00ac932d611c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:31.756312 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-21e08b8c-1a53-41f2-9812-d9afa7ce081d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:31.756914 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-21e08b8c-1a53-41f2-9812-d9afa7ce081d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:31.763474 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21e08b8c-1a53-41f2-9812-d9afa7ce081d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:31.764005 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21e08b8c-1a53-41f2-9812-d9afa7ce081d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:31.764436 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21e08b8c-1a53-41f2-9812-d9afa7ce081d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:31.765127 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21e08b8c-1a53-41f2-9812-d9afa7ce081d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:31.765576 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21e08b8c-1a53-41f2-9812-d9afa7ce081d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:31.765991 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21e08b8c-1a53-41f2-9812-d9afa7ce081d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:31.787172 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-923bb3c0-2909-4195-ba10-00ac932d611c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:31.794744 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-923bb3c0-2909-4195-ba10-00ac932d611c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.172911 Aug 05 10:28:31.795643 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 194/384] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:31 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:31.896713 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-21e08b8c-1a53-41f2-9812-d9afa7ce081d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:31.904586 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-21e08b8c-1a53-41f2-9812-d9afa7ce081d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1314 microversion: 2.1 time: 0.152187 Aug 05 10:28:31.905152 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 191/385] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:31 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:32.490226 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-eebc57cc-5f3d-4c50-9327-99f81ee9cc2e req-6564056f-157b-4ea3-8fe9-a8b2741c6902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e86ee6-2452-4827-aff1-651395a4a8dc", "name": "network-vif-plugged", "status": "completed", "tag": "281bc44c-dd54-4a8e-b7a3-049f2bdcf803"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:28:32.500351 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-eebc57cc-5f3d-4c50-9327-99f81ee9cc2e req-6564056f-157b-4ea3-8fe9-a8b2741c6902 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:32.501940 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-eebc57cc-5f3d-4c50-9327-99f81ee9cc2e req-6564056f-157b-4ea3-8fe9-a8b2741c6902 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:32.502632 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-eebc57cc-5f3d-4c50-9327-99f81ee9cc2e req-6564056f-157b-4ea3-8fe9-a8b2741c6902 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:32.514893 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-eebc57cc-5f3d-4c50-9327-99f81ee9cc2e req-6564056f-157b-4ea3-8fe9-a8b2741c6902 service nova] Creating event network-vif-plugged:281bc44c-dd54-4a8e-b7a3-049f2bdcf803 for instance 08e86ee6-2452-4827-aff1-651395a4a8dc on hv-cinder-81558 Aug 05 10:28:32.520400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-eebc57cc-5f3d-4c50-9327-99f81ee9cc2e req-6564056f-157b-4ea3-8fe9-a8b2741c6902 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034126 Aug 05 10:28:32.520989 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 195/386] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:28:32.604563 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-44232a6c-9c8c-405e-a052-de7963e5c715 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:32.605205 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-44232a6c-9c8c-405e-a052-de7963e5c715 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:32.611392 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-44232a6c-9c8c-405e-a052-de7963e5c715 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:32.611871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-44232a6c-9c8c-405e-a052-de7963e5c715 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:32.612299 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-44232a6c-9c8c-405e-a052-de7963e5c715 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:32.612990 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-44232a6c-9c8c-405e-a052-de7963e5c715 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:32.613438 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-44232a6c-9c8c-405e-a052-de7963e5c715 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:32.614001 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-44232a6c-9c8c-405e-a052-de7963e5c715 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:32.746656 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-44232a6c-9c8c-405e-a052-de7963e5c715 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:32.755262 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-44232a6c-9c8c-405e-a052-de7963e5c715 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1522 microversion: 2.1 time: 0.154740 Aug 05 10:28:32.755822 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 192/387] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:32 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:32.816499 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-e731e976-e1d1-4c3a-8034-14c3d54eda0b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:32.817158 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-e731e976-e1d1-4c3a-8034-14c3d54eda0b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:32.823807 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e731e976-e1d1-4c3a-8034-14c3d54eda0b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:32.824281 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e731e976-e1d1-4c3a-8034-14c3d54eda0b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:32.824707 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e731e976-e1d1-4c3a-8034-14c3d54eda0b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:32.825390 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e731e976-e1d1-4c3a-8034-14c3d54eda0b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:32.825832 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e731e976-e1d1-4c3a-8034-14c3d54eda0b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:32.826248 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e731e976-e1d1-4c3a-8034-14c3d54eda0b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:32.925954 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-30816013-dc11-4eca-9491-597d4c6677af tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:32.926553 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-30816013-dc11-4eca-9491-597d4c6677af tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:32.932828 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30816013-dc11-4eca-9491-597d4c6677af tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:32.933335 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30816013-dc11-4eca-9491-597d4c6677af tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:32.933760 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30816013-dc11-4eca-9491-597d4c6677af tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:32.934439 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30816013-dc11-4eca-9491-597d4c6677af tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:32.934880 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30816013-dc11-4eca-9491-597d4c6677af tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:32.935326 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30816013-dc11-4eca-9491-597d4c6677af tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:32.966842 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e731e976-e1d1-4c3a-8034-14c3d54eda0b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:32.976150 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-e731e976-e1d1-4c3a-8034-14c3d54eda0b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.164053 Aug 05 10:28:32.976986 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 196/388] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:32 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:33.070838 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-30816013-dc11-4eca-9491-597d4c6677af tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:33.078723 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-30816013-dc11-4eca-9491-597d4c6677af tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1314 microversion: 2.1 time: 0.156849 Aug 05 10:28:33.079351 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 193/389] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:32 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:33.780648 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-04fa555a-2551-4aeb-8011-2f4338728776 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:33.781702 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-04fa555a-2551-4aeb-8011-2f4338728776 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:33.793069 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-04fa555a-2551-4aeb-8011-2f4338728776 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:33.793953 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-04fa555a-2551-4aeb-8011-2f4338728776 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:33.794714 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-04fa555a-2551-4aeb-8011-2f4338728776 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:33.795864 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-04fa555a-2551-4aeb-8011-2f4338728776 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:33.796612 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-04fa555a-2551-4aeb-8011-2f4338728776 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:33.797315 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-04fa555a-2551-4aeb-8011-2f4338728776 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:33.942396 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-04fa555a-2551-4aeb-8011-2f4338728776 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:33.954668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-04fa555a-2551-4aeb-8011-2f4338728776 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1522 microversion: 2.1 time: 0.179920 Aug 05 10:28:33.955291 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 197/390] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:33 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:34.000098 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0174d292-76e3-4023-8041-7ba2d1215a61 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:34.000685 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0174d292-76e3-4023-8041-7ba2d1215a61 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:34.008109 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0174d292-76e3-4023-8041-7ba2d1215a61 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:34.008584 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0174d292-76e3-4023-8041-7ba2d1215a61 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:34.009014 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0174d292-76e3-4023-8041-7ba2d1215a61 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:34.009700 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0174d292-76e3-4023-8041-7ba2d1215a61 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:34.010147 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0174d292-76e3-4023-8041-7ba2d1215a61 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:34.010587 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0174d292-76e3-4023-8041-7ba2d1215a61 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:34.099400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-02779650-ea39-4aa4-9d95-e4a0d488901b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:34.100096 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-02779650-ea39-4aa4-9d95-e4a0d488901b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:34.106447 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02779650-ea39-4aa4-9d95-e4a0d488901b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:34.106969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02779650-ea39-4aa4-9d95-e4a0d488901b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:34.107435 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02779650-ea39-4aa4-9d95-e4a0d488901b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:34.108135 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02779650-ea39-4aa4-9d95-e4a0d488901b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:34.108587 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02779650-ea39-4aa4-9d95-e4a0d488901b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:34.109007 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02779650-ea39-4aa4-9d95-e4a0d488901b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:34.142640 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0174d292-76e3-4023-8041-7ba2d1215a61 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:34.150463 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0174d292-76e3-4023-8041-7ba2d1215a61 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.156807 Aug 05 10:28:34.151052 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 194/391] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:33 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:34.244421 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-02779650-ea39-4aa4-9d95-e4a0d488901b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:34.254322 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-02779650-ea39-4aa4-9d95-e4a0d488901b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1314 microversion: 2.1 time: 0.158763 Aug 05 10:28:34.254882 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 198/392] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:34 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:34.976607 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bc4dd2b1-5efe-4dd8-bf9b-7d5fd06c6707 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:34.977214 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bc4dd2b1-5efe-4dd8-bf9b-7d5fd06c6707 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:34.983978 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc4dd2b1-5efe-4dd8-bf9b-7d5fd06c6707 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:34.984469 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc4dd2b1-5efe-4dd8-bf9b-7d5fd06c6707 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:34.984924 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc4dd2b1-5efe-4dd8-bf9b-7d5fd06c6707 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:34.985613 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc4dd2b1-5efe-4dd8-bf9b-7d5fd06c6707 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:34.986071 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc4dd2b1-5efe-4dd8-bf9b-7d5fd06c6707 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:34.986493 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc4dd2b1-5efe-4dd8-bf9b-7d5fd06c6707 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:35.126772 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bc4dd2b1-5efe-4dd8-bf9b-7d5fd06c6707 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:35.138321 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bc4dd2b1-5efe-4dd8-bf9b-7d5fd06c6707 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1522 microversion: 2.1 time: 0.165488 Aug 05 10:28:35.139121 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 195/393] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:34 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:35.172241 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c2351a72-698f-45a2-95a1-0baca5fa581d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:35.173013 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c2351a72-698f-45a2-95a1-0baca5fa581d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:35.179079 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c2351a72-698f-45a2-95a1-0baca5fa581d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:35.179550 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c2351a72-698f-45a2-95a1-0baca5fa581d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:35.179976 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c2351a72-698f-45a2-95a1-0baca5fa581d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:35.180648 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c2351a72-698f-45a2-95a1-0baca5fa581d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:35.181090 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c2351a72-698f-45a2-95a1-0baca5fa581d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:35.181499 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c2351a72-698f-45a2-95a1-0baca5fa581d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:35.283298 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-07a5179c-e362-46e5-8b55-d8c9e87b00ec tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:35.284366 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-07a5179c-e362-46e5-8b55-d8c9e87b00ec tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:35.290716 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07a5179c-e362-46e5-8b55-d8c9e87b00ec tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:35.291251 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07a5179c-e362-46e5-8b55-d8c9e87b00ec tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:35.291674 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07a5179c-e362-46e5-8b55-d8c9e87b00ec tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:35.292372 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07a5179c-e362-46e5-8b55-d8c9e87b00ec tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:35.292827 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07a5179c-e362-46e5-8b55-d8c9e87b00ec tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:35.293252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07a5179c-e362-46e5-8b55-d8c9e87b00ec tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:35.316748 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c2351a72-698f-45a2-95a1-0baca5fa581d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:35.325058 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c2351a72-698f-45a2-95a1-0baca5fa581d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.156652 Aug 05 10:28:35.325636 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 199/394] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:35 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:28:35.429149 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-07a5179c-e362-46e5-8b55-d8c9e87b00ec tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:35.436920 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-07a5179c-e362-46e5-8b55-d8c9e87b00ec tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1314 microversion: 2.1 time: 0.157721 Aug 05 10:28:35.437493 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 196/395] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:35 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:36.161136 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-dbcea5ca-be76-4fa9-b00a-b56af94b83c9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:36.161780 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-dbcea5ca-be76-4fa9-b00a-b56af94b83c9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:36.168200 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dbcea5ca-be76-4fa9-b00a-b56af94b83c9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:36.168719 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dbcea5ca-be76-4fa9-b00a-b56af94b83c9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:36.169153 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dbcea5ca-be76-4fa9-b00a-b56af94b83c9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:36.169847 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dbcea5ca-be76-4fa9-b00a-b56af94b83c9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:36.170329 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dbcea5ca-be76-4fa9-b00a-b56af94b83c9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:36.170788 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dbcea5ca-be76-4fa9-b00a-b56af94b83c9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:36.313026 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-dbcea5ca-be76-4fa9-b00a-b56af94b83c9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:36.321271 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-dbcea5ca-be76-4fa9-b00a-b56af94b83c9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1522 microversion: 2.1 time: 0.164622 Aug 05 10:28:36.321825 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 200/396] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:36 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:36.346156 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-17aea729-641b-48a5-9fd9-9eab5d1ea20a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:36.346731 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-17aea729-641b-48a5-9fd9-9eab5d1ea20a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:36.353466 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17aea729-641b-48a5-9fd9-9eab5d1ea20a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:36.353938 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17aea729-641b-48a5-9fd9-9eab5d1ea20a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:36.354368 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17aea729-641b-48a5-9fd9-9eab5d1ea20a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:36.355089 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17aea729-641b-48a5-9fd9-9eab5d1ea20a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:36.355535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17aea729-641b-48a5-9fd9-9eab5d1ea20a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:36.355948 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17aea729-641b-48a5-9fd9-9eab5d1ea20a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:36.458116 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-53289bff-cb6c-47ce-a5b3-e49b51994640 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:36.458867 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-53289bff-cb6c-47ce-a5b3-e49b51994640 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:36.464905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-53289bff-cb6c-47ce-a5b3-e49b51994640 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:36.465383 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-53289bff-cb6c-47ce-a5b3-e49b51994640 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:36.465995 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-53289bff-cb6c-47ce-a5b3-e49b51994640 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:36.466760 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-53289bff-cb6c-47ce-a5b3-e49b51994640 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:36.467258 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-53289bff-cb6c-47ce-a5b3-e49b51994640 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:36.467839 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-53289bff-cb6c-47ce-a5b3-e49b51994640 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:36.491262 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-17aea729-641b-48a5-9fd9-9eab5d1ea20a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:36.500318 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-17aea729-641b-48a5-9fd9-9eab5d1ea20a tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.158211 Aug 05 10:28:36.501162 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 197/397] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:36 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:36.604355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-53289bff-cb6c-47ce-a5b3-e49b51994640 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:36.612070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-53289bff-cb6c-47ce-a5b3-e49b51994640 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1314 microversion: 2.1 time: 0.158125 Aug 05 10:28:36.612663 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 201/398] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:36 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:37.346596 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7648940a-8bea-490e-b4e2-125475cc3a3d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:37.347635 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7648940a-8bea-490e-b4e2-125475cc3a3d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:37.359236 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7648940a-8bea-490e-b4e2-125475cc3a3d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:37.360042 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7648940a-8bea-490e-b4e2-125475cc3a3d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:37.360760 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7648940a-8bea-490e-b4e2-125475cc3a3d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:37.362267 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7648940a-8bea-490e-b4e2-125475cc3a3d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:37.362727 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7648940a-8bea-490e-b4e2-125475cc3a3d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:37.363176 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7648940a-8bea-490e-b4e2-125475cc3a3d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:37.505536 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7648940a-8bea-490e-b4e2-125475cc3a3d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:37.513209 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7648940a-8bea-490e-b4e2-125475cc3a3d tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1522 microversion: 2.1 time: 0.173304 Aug 05 10:28:37.513767 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 198/399] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:37 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:37.526460 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ba859aa2-6d39-4b47-90d3-e6e80f02c712 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:37.527056 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-ba859aa2-6d39-4b47-90d3-e6e80f02c712 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:37.533217 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ba859aa2-6d39-4b47-90d3-e6e80f02c712 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:37.533850 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ba859aa2-6d39-4b47-90d3-e6e80f02c712 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:37.534628 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ba859aa2-6d39-4b47-90d3-e6e80f02c712 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:37.535349 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ba859aa2-6d39-4b47-90d3-e6e80f02c712 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:37.535789 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ba859aa2-6d39-4b47-90d3-e6e80f02c712 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:37.536214 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ba859aa2-6d39-4b47-90d3-e6e80f02c712 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:37.632271 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b5a04795-e976-46fa-ae36-a9b61e4bfe5b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:37.632875 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b5a04795-e976-46fa-ae36-a9b61e4bfe5b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:37.639373 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b5a04795-e976-46fa-ae36-a9b61e4bfe5b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:37.639857 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b5a04795-e976-46fa-ae36-a9b61e4bfe5b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:37.640289 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b5a04795-e976-46fa-ae36-a9b61e4bfe5b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:37.640982 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b5a04795-e976-46fa-ae36-a9b61e4bfe5b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:37.641434 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b5a04795-e976-46fa-ae36-a9b61e4bfe5b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:37.641873 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b5a04795-e976-46fa-ae36-a9b61e4bfe5b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:37.646213 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:28:37.681264 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ba859aa2-6d39-4b47-90d3-e6e80f02c712 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:37.688926 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ba859aa2-6d39-4b47-90d3-e6e80f02c712 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1357 microversion: 2.1 time: 0.166783 Aug 05 10:28:37.693855 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 202/400] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:37 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:37.775152 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b5a04795-e976-46fa-ae36-a9b61e4bfe5b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:37.783189 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b5a04795-e976-46fa-ae36-a9b61e4bfe5b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1314 microversion: 2.1 time: 0.154605 Aug 05 10:28:37.783913 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 199/401] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:37 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:38.540214 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c8199a85-1474-492e-8e86-1b61ada9bed8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:38.540214 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c8199a85-1474-492e-8e86-1b61ada9bed8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:38.541883 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c8199a85-1474-492e-8e86-1b61ada9bed8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:38.542375 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c8199a85-1474-492e-8e86-1b61ada9bed8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:38.543019 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c8199a85-1474-492e-8e86-1b61ada9bed8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:38.547889 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c8199a85-1474-492e-8e86-1b61ada9bed8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:38.548492 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c8199a85-1474-492e-8e86-1b61ada9bed8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:38.549150 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c8199a85-1474-492e-8e86-1b61ada9bed8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:38.696208 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c8199a85-1474-492e-8e86-1b61ada9bed8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:38.707224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c8199a85-1474-492e-8e86-1b61ada9bed8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1522 microversion: 2.1 time: 0.176901 Aug 05 10:28:38.707818 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 203/402] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:38 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:38.710842 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9160a208-4e36-4c0c-a77b-b65c3eebcf7d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:38.711524 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9160a208-4e36-4c0c-a77b-b65c3eebcf7d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:38.718252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9160a208-4e36-4c0c-a77b-b65c3eebcf7d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:38.718733 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9160a208-4e36-4c0c-a77b-b65c3eebcf7d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:38.719205 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9160a208-4e36-4c0c-a77b-b65c3eebcf7d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:38.719900 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9160a208-4e36-4c0c-a77b-b65c3eebcf7d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:38.720355 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9160a208-4e36-4c0c-a77b-b65c3eebcf7d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:38.720776 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9160a208-4e36-4c0c-a77b-b65c3eebcf7d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:38.805044 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-9cab2810-990d-4c42-a973-c5e5829c0ab6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:38.805676 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-9cab2810-990d-4c42-a973-c5e5829c0ab6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:38.811982 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9cab2810-990d-4c42-a973-c5e5829c0ab6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:38.812456 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9cab2810-990d-4c42-a973-c5e5829c0ab6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:38.812902 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9cab2810-990d-4c42-a973-c5e5829c0ab6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:38.813637 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9cab2810-990d-4c42-a973-c5e5829c0ab6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:38.814539 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9cab2810-990d-4c42-a973-c5e5829c0ab6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:38.815017 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9cab2810-990d-4c42-a973-c5e5829c0ab6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:38.858482 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9160a208-4e36-4c0c-a77b-b65c3eebcf7d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:38.866776 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9160a208-4e36-4c0c-a77b-b65c3eebcf7d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1547 microversion: 2.1 time: 0.159890 Aug 05 10:28:38.867376 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 200/403] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:38 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:38.887990 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f5800a33-cdfa-4e75-9d24-620295ea2c54 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:38.888589 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f5800a33-cdfa-4e75-9d24-620295ea2c54 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:38.894821 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f5800a33-cdfa-4e75-9d24-620295ea2c54 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:38.895335 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f5800a33-cdfa-4e75-9d24-620295ea2c54 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:38.896396 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f5800a33-cdfa-4e75-9d24-620295ea2c54 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:38.897202 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f5800a33-cdfa-4e75-9d24-620295ea2c54 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:38.897668 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f5800a33-cdfa-4e75-9d24-620295ea2c54 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:38.898081 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f5800a33-cdfa-4e75-9d24-620295ea2c54 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:38.952644 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-9cab2810-990d-4c42-a973-c5e5829c0ab6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:38.960509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-9cab2810-990d-4c42-a973-c5e5829c0ab6 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1314 microversion: 2.1 time: 0.159442 Aug 05 10:28:38.961273 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 204/404] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:38 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:39.039328 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f5800a33-cdfa-4e75-9d24-620295ea2c54 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:39.047414 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f5800a33-cdfa-4e75-9d24-620295ea2c54 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1547 microversion: 2.1 time: 0.163154 Aug 05 10:28:39.047895 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 201/405] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:38 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:39.067362 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-e40b7cc5-baac-4ffb-8537-4bef1638c64d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:39.072101 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e40b7cc5-baac-4ffb-8537-4bef1638c64d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:39.072856 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-e40b7cc5-baac-4ffb-8537-4bef1638c64d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Searching by: {'deleted': False, 'project_id': 'db2897585ac048ae93df3e38d1437e6e'} {{(pid=117831) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 05 10:28:39.080467 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e40b7cc5-baac-4ffb-8537-4bef1638c64d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:39.081096 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e40b7cc5-baac-4ffb-8537-4bef1638c64d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:39.081442 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e40b7cc5-baac-4ffb-8537-4bef1638c64d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:39.082139 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e40b7cc5-baac-4ffb-8537-4bef1638c64d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:39.082640 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e40b7cc5-baac-4ffb-8537-4bef1638c64d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:39.083116 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e40b7cc5-baac-4ffb-8537-4bef1638c64d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:39.174693 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.multi_cell_list [None req-e40b7cc5-baac-4ffb-8537-4bef1638c64d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117831) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 05 10:28:39.249124 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-ef80ca0f-a8f9-4a41-9963-414f87d8c695 req-fc8e1a24-4ae2-4c8c-8914-6f575c35656c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4", "name": "network-vif-plugged", "status": "completed", "tag": "66779bc6-3193-4b1c-9bbc-d146c205fa42"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:28:39.263708 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-ef80ca0f-a8f9-4a41-9963-414f87d8c695 req-fc8e1a24-4ae2-4c8c-8914-6f575c35656c service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:39.264422 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-ef80ca0f-a8f9-4a41-9963-414f87d8c695 req-fc8e1a24-4ae2-4c8c-8914-6f575c35656c service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:39.265104 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-ef80ca0f-a8f9-4a41-9963-414f87d8c695 req-fc8e1a24-4ae2-4c8c-8914-6f575c35656c service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:39.279435 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-ef80ca0f-a8f9-4a41-9963-414f87d8c695 req-fc8e1a24-4ae2-4c8c-8914-6f575c35656c service nova] Creating event network-vif-plugged:66779bc6-3193-4b1c-9bbc-d146c205fa42 for instance 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 on hv-cinder-81558 Aug 05 10:28:39.282438 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-e40b7cc5-baac-4ffb-8537-4bef1638c64d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.219263 Aug 05 10:28:39.284984 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-ef80ca0f-a8f9-4a41-9963-414f87d8c695 req-fc8e1a24-4ae2-4c8c-8914-6f575c35656c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042181 Aug 05 10:28:39.285990 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 202/406] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:28:39.289483 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 205/407] 10.222.0.40 () {58 vars in 1125 bytes} [Fri Aug 5 10:28:39 2022] GET /compute/v2.1/servers => generated 342 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:28:39.294987 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-afdeb941-e0e0-463b-893d-a910bc041b61 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:39.295697 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-afdeb941-e0e0-463b-893d-a910bc041b61 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:39.301956 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afdeb941-e0e0-463b-893d-a910bc041b61 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:39.302365 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afdeb941-e0e0-463b-893d-a910bc041b61 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:39.302790 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afdeb941-e0e0-463b-893d-a910bc041b61 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:39.303512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afdeb941-e0e0-463b-893d-a910bc041b61 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:39.303960 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afdeb941-e0e0-463b-893d-a910bc041b61 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:39.304375 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afdeb941-e0e0-463b-893d-a910bc041b61 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:39.445070 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-afdeb941-e0e0-463b-893d-a910bc041b61 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:39.452753 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-afdeb941-e0e0-463b-893d-a910bc041b61 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1547 microversion: 2.1 time: 0.161987 Aug 05 10:28:39.453319 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 203/408] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:39 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:28:39.728085 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-eda71db3-cd42-480c-b286-72fb2fbf0e16 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:39.728787 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-eda71db3-cd42-480c-b286-72fb2fbf0e16 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:39.735289 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-eda71db3-cd42-480c-b286-72fb2fbf0e16 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:39.735780 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-eda71db3-cd42-480c-b286-72fb2fbf0e16 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:39.736828 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-eda71db3-cd42-480c-b286-72fb2fbf0e16 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:39.737535 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-eda71db3-cd42-480c-b286-72fb2fbf0e16 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:39.737987 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-eda71db3-cd42-480c-b286-72fb2fbf0e16 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:39.738394 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-eda71db3-cd42-480c-b286-72fb2fbf0e16 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:39.882215 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-eda71db3-cd42-480c-b286-72fb2fbf0e16 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:39.893683 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-eda71db3-cd42-480c-b286-72fb2fbf0e16 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1522 microversion: 2.1 time: 0.169556 Aug 05 10:28:39.894593 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 206/409] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:39 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:39.984072 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e658e6e4-46fd-4d57-b917-12684818d214 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:39.984682 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e658e6e4-46fd-4d57-b917-12684818d214 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:39.992637 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e658e6e4-46fd-4d57-b917-12684818d214 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:39.993142 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e658e6e4-46fd-4d57-b917-12684818d214 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:39.993587 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e658e6e4-46fd-4d57-b917-12684818d214 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:39.994318 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e658e6e4-46fd-4d57-b917-12684818d214 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:39.994776 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e658e6e4-46fd-4d57-b917-12684818d214 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:39.995247 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e658e6e4-46fd-4d57-b917-12684818d214 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:40.126590 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e658e6e4-46fd-4d57-b917-12684818d214 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:40.138142 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e658e6e4-46fd-4d57-b917-12684818d214 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1314 microversion: 2.1 time: 0.159868 Aug 05 10:28:40.138869 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 204/410] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:39 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:40.920989 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b1f97c80-600a-41bb-bee4-1c6d80fc08cd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:40.921827 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b1f97c80-600a-41bb-bee4-1c6d80fc08cd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:40.929250 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b1f97c80-600a-41bb-bee4-1c6d80fc08cd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:40.929789 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b1f97c80-600a-41bb-bee4-1c6d80fc08cd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:40.930269 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b1f97c80-600a-41bb-bee4-1c6d80fc08cd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:40.931104 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b1f97c80-600a-41bb-bee4-1c6d80fc08cd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:40.931632 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b1f97c80-600a-41bb-bee4-1c6d80fc08cd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:40.932104 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b1f97c80-600a-41bb-bee4-1c6d80fc08cd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:41.078420 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b1f97c80-600a-41bb-bee4-1c6d80fc08cd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:41.086525 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b1f97c80-600a-41bb-bee4-1c6d80fc08cd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1522 microversion: 2.1 time: 0.173129 Aug 05 10:28:41.090953 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 207/411] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:40 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:41.161000 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3243523b-c40c-4e48-b227-65b8f95b704c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:41.161702 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3243523b-c40c-4e48-b227-65b8f95b704c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:41.168742 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3243523b-c40c-4e48-b227-65b8f95b704c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:41.169300 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3243523b-c40c-4e48-b227-65b8f95b704c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:41.169845 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3243523b-c40c-4e48-b227-65b8f95b704c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:41.170576 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3243523b-c40c-4e48-b227-65b8f95b704c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:41.171193 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3243523b-c40c-4e48-b227-65b8f95b704c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:41.171629 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3243523b-c40c-4e48-b227-65b8f95b704c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:41.315846 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3243523b-c40c-4e48-b227-65b8f95b704c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:41.323829 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3243523b-c40c-4e48-b227-65b8f95b704c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1314 microversion: 2.1 time: 0.167263 Aug 05 10:28:41.324388 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 205/412] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:41 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:42.091910 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-3793fdce-f16f-42bb-a3a5-c4ff3a35795f tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6dce2d6a-f7d6-48a3-ab45-ced42e95fb2a"}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:28:42.094254 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-3793fdce-f16f-42bb-a3a5-c4ff3a35795f tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:42.101528 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3793fdce-f16f-42bb-a3a5-c4ff3a35795f tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:42.102414 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3793fdce-f16f-42bb-a3a5-c4ff3a35795f tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:42.102499 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3793fdce-f16f-42bb-a3a5-c4ff3a35795f tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:42.103187 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3793fdce-f16f-42bb-a3a5-c4ff3a35795f tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:42.103651 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3793fdce-f16f-42bb-a3a5-c4ff3a35795f tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:42.104222 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3793fdce-f16f-42bb-a3a5-c4ff3a35795f tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:42.107825 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ddb76977-8e64-4c92-a3f4-f1916a3e6ae4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:42.108473 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ddb76977-8e64-4c92-a3f4-f1916a3e6ae4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:42.115237 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ddb76977-8e64-4c92-a3f4-f1916a3e6ae4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:42.115730 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ddb76977-8e64-4c92-a3f4-f1916a3e6ae4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:42.116214 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ddb76977-8e64-4c92-a3f4-f1916a3e6ae4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:42.116918 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ddb76977-8e64-4c92-a3f4-f1916a3e6ae4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:42.117366 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ddb76977-8e64-4c92-a3f4-f1916a3e6ae4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:42.118054 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ddb76977-8e64-4c92-a3f4-f1916a3e6ae4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:42.271518 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ddb76977-8e64-4c92-a3f4-f1916a3e6ae4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:42.280602 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ddb76977-8e64-4c92-a3f4-f1916a3e6ae4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1522 microversion: 2.1 time: 0.176571 Aug 05 10:28:42.281180 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 206/413] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:42 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:42.344763 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-03270d0f-3be5-477d-8090-89d8f505833b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:42.345372 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-03270d0f-3be5-477d-8090-89d8f505833b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:42.351812 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03270d0f-3be5-477d-8090-89d8f505833b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:42.352496 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03270d0f-3be5-477d-8090-89d8f505833b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:42.353104 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03270d0f-3be5-477d-8090-89d8f505833b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:42.353984 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03270d0f-3be5-477d-8090-89d8f505833b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:42.354589 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03270d0f-3be5-477d-8090-89d8f505833b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:42.355196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03270d0f-3be5-477d-8090-89d8f505833b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:42.442213 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-3793fdce-f16f-42bb-a3a5-c4ff3a35795f tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "POST /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.354126 Aug 05 10:28:42.443403 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 208/414] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 10:28:42 2022] POST /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc/os-volume_attachments => generated 194 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:28:42.518150 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-03270d0f-3be5-477d-8090-89d8f505833b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:42.526241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-03270d0f-3be5-477d-8090-89d8f505833b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1498 microversion: 2.1 time: 0.185314 Aug 05 10:28:42.526937 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 207/415] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:42 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1498 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:28:43.306516 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-7e473479-f78c-4eb4-b189-f776eb708554 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:43.307247 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-7e473479-f78c-4eb4-b189-f776eb708554 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:43.314175 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7e473479-f78c-4eb4-b189-f776eb708554 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:43.314654 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7e473479-f78c-4eb4-b189-f776eb708554 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:43.315120 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7e473479-f78c-4eb4-b189-f776eb708554 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:43.316459 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7e473479-f78c-4eb4-b189-f776eb708554 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:43.316924 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7e473479-f78c-4eb4-b189-f776eb708554 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:43.317350 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7e473479-f78c-4eb4-b189-f776eb708554 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:43.321399 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:28:43.457105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-7e473479-f78c-4eb4-b189-f776eb708554 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:43.466313 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-7e473479-f78c-4eb4-b189-f776eb708554 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1522 microversion: 2.1 time: 0.166681 Aug 05 10:28:43.466944 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 209/416] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:43 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:43.528154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-605e8910-6dc4-4015-bc33-334a298faa5f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:43.528665 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-605e8910-6dc4-4015-bc33-334a298faa5f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:43.535939 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-605e8910-6dc4-4015-bc33-334a298faa5f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:43.536419 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-605e8910-6dc4-4015-bc33-334a298faa5f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:43.536853 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-605e8910-6dc4-4015-bc33-334a298faa5f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:43.537558 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-605e8910-6dc4-4015-bc33-334a298faa5f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:43.538010 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-605e8910-6dc4-4015-bc33-334a298faa5f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:43.538432 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-605e8910-6dc4-4015-bc33-334a298faa5f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:43.566871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-605e8910-6dc4-4015-bc33-334a298faa5f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 10:28:43.647608 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-605e8910-6dc4-4015-bc33-334a298faa5f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 204 len: 0 microversion: 2.1 time: 0.122981 Aug 05 10:28:43.648189 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 208/417] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:28:43 2022] DELETE /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:28:43.656308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-af7092da-b3ed-4675-b56e-6ee02cd33b06 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:43.656914 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-af7092da-b3ed-4675-b56e-6ee02cd33b06 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:43.666270 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-af7092da-b3ed-4675-b56e-6ee02cd33b06 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:43.666746 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-af7092da-b3ed-4675-b56e-6ee02cd33b06 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:43.667279 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-af7092da-b3ed-4675-b56e-6ee02cd33b06 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:43.667888 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-af7092da-b3ed-4675-b56e-6ee02cd33b06 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:43.668331 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-af7092da-b3ed-4675-b56e-6ee02cd33b06 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:43.668745 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-af7092da-b3ed-4675-b56e-6ee02cd33b06 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:43.808201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-af7092da-b3ed-4675-b56e-6ee02cd33b06 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:43.815768 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-af7092da-b3ed-4675-b56e-6ee02cd33b06 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1504 microversion: 2.1 time: 0.163110 Aug 05 10:28:43.816389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 210/418] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:43 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:28:44.488307 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1f3cdbe6-e6e2-4227-8248-6c3311a47cad tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:44.489016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1f3cdbe6-e6e2-4227-8248-6c3311a47cad tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:44.495549 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f3cdbe6-e6e2-4227-8248-6c3311a47cad tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:44.496039 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f3cdbe6-e6e2-4227-8248-6c3311a47cad tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:44.496471 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f3cdbe6-e6e2-4227-8248-6c3311a47cad tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:44.497193 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f3cdbe6-e6e2-4227-8248-6c3311a47cad tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:44.497640 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f3cdbe6-e6e2-4227-8248-6c3311a47cad tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:44.498059 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f3cdbe6-e6e2-4227-8248-6c3311a47cad tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:44.644548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1f3cdbe6-e6e2-4227-8248-6c3311a47cad tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:44.651935 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1f3cdbe6-e6e2-4227-8248-6c3311a47cad tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1522 microversion: 2.1 time: 0.167906 Aug 05 10:28:44.652523 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 209/419] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:44 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:44.836938 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-dc5b1629-145f-47c1-b1de-1f8eaff5ea55 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:44.837863 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-dc5b1629-145f-47c1-b1de-1f8eaff5ea55 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:44.844692 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dc5b1629-145f-47c1-b1de-1f8eaff5ea55 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:44.845165 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dc5b1629-145f-47c1-b1de-1f8eaff5ea55 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:44.845587 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dc5b1629-145f-47c1-b1de-1f8eaff5ea55 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:44.846273 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dc5b1629-145f-47c1-b1de-1f8eaff5ea55 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:44.846817 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dc5b1629-145f-47c1-b1de-1f8eaff5ea55 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:44.847421 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dc5b1629-145f-47c1-b1de-1f8eaff5ea55 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:44.982042 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-dc5b1629-145f-47c1-b1de-1f8eaff5ea55 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:44.990279 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-dc5b1629-145f-47c1-b1de-1f8eaff5ea55 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1504 microversion: 2.1 time: 0.157431 Aug 05 10:28:44.990825 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 211/420] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:44 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:45.673141 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-03de0329-f330-4fc4-a2ec-fce40c52d497 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:45.673718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-03de0329-f330-4fc4-a2ec-fce40c52d497 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:45.680449 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03de0329-f330-4fc4-a2ec-fce40c52d497 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:45.681114 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03de0329-f330-4fc4-a2ec-fce40c52d497 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:45.681551 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03de0329-f330-4fc4-a2ec-fce40c52d497 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:45.682246 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03de0329-f330-4fc4-a2ec-fce40c52d497 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:45.682858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03de0329-f330-4fc4-a2ec-fce40c52d497 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:45.683307 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03de0329-f330-4fc4-a2ec-fce40c52d497 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:45.838379 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-03de0329-f330-4fc4-a2ec-fce40c52d497 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:45.848712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-03de0329-f330-4fc4-a2ec-fce40c52d497 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1522 microversion: 2.1 time: 0.179289 Aug 05 10:28:45.849441 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 210/421] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:45 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:46.012348 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-7bc93ab4-aa79-4da8-b9e1-424c877b611a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:46.013096 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-7bc93ab4-aa79-4da8-b9e1-424c877b611a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:46.020567 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7bc93ab4-aa79-4da8-b9e1-424c877b611a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:46.021176 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7bc93ab4-aa79-4da8-b9e1-424c877b611a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:46.021903 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7bc93ab4-aa79-4da8-b9e1-424c877b611a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:46.022697 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7bc93ab4-aa79-4da8-b9e1-424c877b611a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:46.023275 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7bc93ab4-aa79-4da8-b9e1-424c877b611a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:46.023791 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7bc93ab4-aa79-4da8-b9e1-424c877b611a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:46.245312 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-7bc93ab4-aa79-4da8-b9e1-424c877b611a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:46.254828 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-7bc93ab4-aa79-4da8-b9e1-424c877b611a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1504 microversion: 2.1 time: 0.246547 Aug 05 10:28:46.267103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 212/422] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:46 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1504 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:46.294695 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-8a5a2b2d-47c8-439f-852c-cc736d2b10eb req-fe649f80-6501-415e-9f48-27015c39c6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4", "name": "network-vif-deleted", "tag": "66779bc6-3193-4b1c-9bbc-d146c205fa42"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:28:46.304270 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8a5a2b2d-47c8-439f-852c-cc736d2b10eb req-fe649f80-6501-415e-9f48-27015c39c6a3 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:46.304974 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8a5a2b2d-47c8-439f-852c-cc736d2b10eb req-fe649f80-6501-415e-9f48-27015c39c6a3 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:46.305431 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8a5a2b2d-47c8-439f-852c-cc736d2b10eb req-fe649f80-6501-415e-9f48-27015c39c6a3 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:46.316695 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-8a5a2b2d-47c8-439f-852c-cc736d2b10eb req-fe649f80-6501-415e-9f48-27015c39c6a3 service nova] Creating event network-vif-deleted:66779bc6-3193-4b1c-9bbc-d146c205fa42 for instance 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 on hv-cinder-81558 Aug 05 10:28:46.321434 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-8a5a2b2d-47c8-439f-852c-cc736d2b10eb req-fe649f80-6501-415e-9f48-27015c39c6a3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030513 Aug 05 10:28:46.322002 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 211/423] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:28:46.873565 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-4a175ade-aa1b-4df8-8c32-0107e382ff19 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:46.874550 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-4a175ade-aa1b-4df8-8c32-0107e382ff19 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:46.885130 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4a175ade-aa1b-4df8-8c32-0107e382ff19 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:46.885914 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4a175ade-aa1b-4df8-8c32-0107e382ff19 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:46.886641 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4a175ade-aa1b-4df8-8c32-0107e382ff19 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:46.887824 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4a175ade-aa1b-4df8-8c32-0107e382ff19 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:46.888566 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4a175ade-aa1b-4df8-8c32-0107e382ff19 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:46.889259 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4a175ade-aa1b-4df8-8c32-0107e382ff19 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:47.038658 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-4a175ade-aa1b-4df8-8c32-0107e382ff19 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:47.046760 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-4a175ade-aa1b-4df8-8c32-0107e382ff19 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1522 microversion: 2.1 time: 0.179653 Aug 05 10:28:47.047365 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 213/424] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:46 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:47.281776 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-485f4d2e-9189-4c02-9662-45403ab646eb tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:47.282812 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-485f4d2e-9189-4c02-9662-45403ab646eb tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:47.292341 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-485f4d2e-9189-4c02-9662-45403ab646eb tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:47.292987 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-485f4d2e-9189-4c02-9662-45403ab646eb tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:47.293529 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-485f4d2e-9189-4c02-9662-45403ab646eb tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:47.294546 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-485f4d2e-9189-4c02-9662-45403ab646eb tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:47.295099 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-485f4d2e-9189-4c02-9662-45403ab646eb tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:47.295654 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-485f4d2e-9189-4c02-9662-45403ab646eb tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:47.367812 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-485f4d2e-9189-4c02-9662-45403ab646eb tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:47.375877 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-485f4d2e-9189-4c02-9662-45403ab646eb tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1462 microversion: 2.1 time: 0.102193 Aug 05 10:28:47.376435 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 212/425] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:47 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1462 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:48.069643 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-735e76a4-35cb-431c-9f1d-e5f191db1758 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:48.070200 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-735e76a4-35cb-431c-9f1d-e5f191db1758 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:48.077975 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-735e76a4-35cb-431c-9f1d-e5f191db1758 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:48.078957 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-735e76a4-35cb-431c-9f1d-e5f191db1758 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:48.079660 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-735e76a4-35cb-431c-9f1d-e5f191db1758 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:48.080370 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-735e76a4-35cb-431c-9f1d-e5f191db1758 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:48.080853 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-735e76a4-35cb-431c-9f1d-e5f191db1758 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:48.081425 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-735e76a4-35cb-431c-9f1d-e5f191db1758 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:48.254369 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-735e76a4-35cb-431c-9f1d-e5f191db1758 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:48.261990 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-735e76a4-35cb-431c-9f1d-e5f191db1758 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1522 microversion: 2.1 time: 0.197334 Aug 05 10:28:48.262565 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 214/426] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:48 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:48.397975 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f2348ff6-f804-4fd9-af78-4f235d1e2f32 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:48.398586 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f2348ff6-f804-4fd9-af78-4f235d1e2f32 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:48.405621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2348ff6-f804-4fd9-af78-4f235d1e2f32 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:48.406124 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2348ff6-f804-4fd9-af78-4f235d1e2f32 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:48.406557 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2348ff6-f804-4fd9-af78-4f235d1e2f32 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:48.407300 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2348ff6-f804-4fd9-af78-4f235d1e2f32 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:48.407951 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2348ff6-f804-4fd9-af78-4f235d1e2f32 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:48.408223 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2348ff6-f804-4fd9-af78-4f235d1e2f32 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:48.443757 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2348ff6-f804-4fd9-af78-4f235d1e2f32 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:48.444477 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2348ff6-f804-4fd9-af78-4f235d1e2f32 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:48.445093 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2348ff6-f804-4fd9-af78-4f235d1e2f32 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:48.445547 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-f2348ff6-f804-4fd9-af78-4f235d1e2f32 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lazy-loading 'fault' on Instance uuid 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:28:48.503461 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f2348ff6-f804-4fd9-af78-4f235d1e2f32 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:48.512196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f2348ff6-f804-4fd9-af78-4f235d1e2f32 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 200 len: 1304 microversion: 2.1 time: 0.118801 Aug 05 10:28:48.512766 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 213/427] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:48 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:49.283253 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-1f21fdb1-b994-482b-861c-dc185254486f tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:49.284191 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-1f21fdb1-b994-482b-861c-dc185254486f tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:49.286683 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=2 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:28:49.292374 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1f21fdb1-b994-482b-861c-dc185254486f tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:49.292870 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1f21fdb1-b994-482b-861c-dc185254486f tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:49.293308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1f21fdb1-b994-482b-861c-dc185254486f tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:49.293977 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1f21fdb1-b994-482b-861c-dc185254486f tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:49.294424 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1f21fdb1-b994-482b-861c-dc185254486f tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:49.294844 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1f21fdb1-b994-482b-861c-dc185254486f tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:49.430811 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-1f21fdb1-b994-482b-861c-dc185254486f tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:49.438566 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-1f21fdb1-b994-482b-861c-dc185254486f tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1522 microversion: 2.1 time: 0.159281 Aug 05 10:28:49.439163 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 215/428] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:49 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:49.533145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-27ce706b-8e27-4b67-a4bc-b9a509b63b3f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:49.534251 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-27ce706b-8e27-4b67-a4bc-b9a509b63b3f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:49.541326 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27ce706b-8e27-4b67-a4bc-b9a509b63b3f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:49.541950 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27ce706b-8e27-4b67-a4bc-b9a509b63b3f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:49.542503 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27ce706b-8e27-4b67-a4bc-b9a509b63b3f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:49.543352 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27ce706b-8e27-4b67-a4bc-b9a509b63b3f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:49.544486 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27ce706b-8e27-4b67-a4bc-b9a509b63b3f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:49.544973 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27ce706b-8e27-4b67-a4bc-b9a509b63b3f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:49.559517 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-27ce706b-8e27-4b67-a4bc-b9a509b63b3f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] HTTP exception thrown: Instance 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 could not be found. Aug 05 10:28:49.561177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-27ce706b-8e27-4b67-a4bc-b9a509b63b3f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Request method failure captured: Aug 05 10:28:49.561177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 HTTP/1.1 Aug 05 10:28:49.561177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:28:49.561177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:28:49.561177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:28:49.561177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:28:49.561177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:28:49.561177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:28:49.561177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:28:49.561177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:28:49.561177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PCw7BpVC0e9sesMLPhGZN06ekesH-ZQijrgnA4zatkfTKmAIx1k2o4MseFD0eqioCNHUSlJnsM7SE8SONYwoRjsx_5CHd6spvPPaYzoIiQj33ysITxnSxYjBCdCaJUEAsseFs5whcpvX1xsvTZFBit0GiQKENTVsj_K-dyl07HcDY4 Aug 05 10:28:49.561177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:28:49.561177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:28:49.561177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:28:49.561177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:28:49.561177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:28:49.561177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:28:49.561177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: a4a8139ee97548e89fcb7b38c5bd99fe Aug 05 10:28:49.561177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesActionsTest-52410631 Aug 05 10:28:49.561177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:28:49.561177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:28:49.563358 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a4a8139ee97548e89fcb7b38c5bd99fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a4a8139ee97548e89fcb7b38c5bd99fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4a8139ee97548e89fcb7b38c5bd99fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4a8139ee97548e89fcb7b38c5bd99fe"}]}] Aug 05 10:28:49.563358 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesActionsTest-52410631 Aug 05 10:28:49.563358 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: a4a8139ee97548e89fcb7b38c5bd99fe Aug 05 10:28:49.563358 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesActionsTest-52410631 Aug 05 10:28:49.563358 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesActionsTest-52410631-project Aug 05 10:28:49.563358 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:28:49.563358 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:28:49.563358 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: 7723cdbd378743378b1fccc2d15bc53b Aug 05 10:28:49.563358 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesActionsTest-52410631-project Aug 05 10:28:49.563358 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:28:49.563358 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Instance 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 could not be found. Aug 05 10:28:49.563358 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': '5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4'} Aug 05 10:28:49.564143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:28:49.564143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:28:49.564143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:28:49.564143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:28:49.564143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:28:49.564143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:28:49.564143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:28:49.564143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:28:49.564143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:28:49.564143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:28:49.564143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 could not be found. Aug 05 10:28:49.564143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:28:49.564143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:28:49.564143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:28:49.564143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:28:49.564143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:28:49.564143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:28:49.564143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:28:49.564143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:28:49.564143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:28:49.565420 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:28:49.565420 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:28:49.565420 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:28:49.565420 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:28:49.565420 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:28:49.565420 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:28:49.565420 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:28:49.565420 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 could not be found. Aug 05 10:28:49.565420 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:28:49.565420 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:28:49.565420 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:28:49.565420 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:28:49.565420 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:28:49.565420 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:28:49.565420 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:28:49.565420 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:28:49.565420 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 could not be found. Aug 05 10:28:49.565420 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:28:49.566459 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-27ce706b-8e27-4b67-a4bc-b9a509b63b3f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Returning 404 to user: Instance 5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:28:49.566459 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-27ce706b-8e27-4b67-a4bc-b9a509b63b3f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4" status: 404 len: 111 microversion: 2.1 time: 0.033460 Aug 05 10:28:49.566459 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 214/429] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:49 2022] GET /compute/v2.1/servers/5a2f7443-8b0b-4d7a-830f-a59b9fc0a9d4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:28:49.671135 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c42a586f-41f6-4338-a3f8-16706fcf5cc8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-301120192", "imageRef": "6163bb7c-dfd7-4fb1-a3cb-9f4818243f78", "flavorRef": "452", "networks": [{"uuid": "96fa5b29-49f1-4170-a5e8-3eb666666ae8"}]}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:28:49.723963 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.network.neutron [None req-c42a586f-41f6-4338-a3f8-16706fcf5cc8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] validate_networks() for [('96fa5b29-49f1-4170-a5e8-3eb666666ae8', None, None, None, None, None)] {{(pid=117831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 10:28:50.091984 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-c42a586f-41f6-4338-a3f8-16706fcf5cc8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Flavor limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 10:28:50.092404 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-c42a586f-41f6-4338-a3f8-16706fcf5cc8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Image limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 10:28:50.092908 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-c42a586f-41f6-4338-a3f8-16706fcf5cc8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Flavor pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 10:28:50.093317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-c42a586f-41f6-4338-a3f8-16706fcf5cc8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Image pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 10:28:50.093749 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-c42a586f-41f6-4338-a3f8-16706fcf5cc8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 10:28:50.103357 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c42a586f-41f6-4338-a3f8-16706fcf5cc8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:50.103888 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c42a586f-41f6-4338-a3f8-16706fcf5cc8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:50.104322 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c42a586f-41f6-4338-a3f8-16706fcf5cc8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:50.105044 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c42a586f-41f6-4338-a3f8-16706fcf5cc8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:50.105491 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c42a586f-41f6-4338-a3f8-16706fcf5cc8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:50.105911 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c42a586f-41f6-4338-a3f8-16706fcf5cc8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:50.122508 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-c42a586f-41f6-4338-a3f8-16706fcf5cc8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Getting quotas for project a4a8139ee97548e89fcb7b38c5bd99fe. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:28:50.126572 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-c42a586f-41f6-4338-a3f8-16706fcf5cc8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Getting quotas for user 7723cdbd378743378b1fccc2d15bc53b and project a4a8139ee97548e89fcb7b38c5bd99fe. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:28:50.137829 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c42a586f-41f6-4338-a3f8-16706fcf5cc8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Going to run 1 instances... {{(pid=117831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 10:28:50.140348 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c42a586f-41f6-4338-a3f8-16706fcf5cc8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 45eeb821-0eca-4aac-9bfa-7abf8340adbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6163bb7c-dfd7-4fb1-a3cb-9f4818243f78',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 10:28:50.190914 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c42a586f-41f6-4338-a3f8-16706fcf5cc8 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.523140 Aug 05 10:28:50.193403 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 216/430] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 10:28:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 10:28:50.203309 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1d4cf834-719b-4e8c-b8c5-d77839ce59d9 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:50.203923 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1d4cf834-719b-4e8c-b8c5-d77839ce59d9 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 45eeb821-0eca-4aac-9bfa-7abf8340adbe] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:50.277012 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1d4cf834-719b-4e8c-b8c5-d77839ce59d9 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:50.284156 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1d4cf834-719b-4e8c-b8c5-d77839ce59d9 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe" status: 200 len: 1213 microversion: 2.1 time: 0.084758 Aug 05 10:28:50.284712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 215/431] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:50 2022] GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:50.459954 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-e55cb57a-6ce7-40a7-ada3-1eace55b0e20 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:50.460574 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-e55cb57a-6ce7-40a7-ada3-1eace55b0e20 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:50.467292 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e55cb57a-6ce7-40a7-ada3-1eace55b0e20 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:50.467785 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e55cb57a-6ce7-40a7-ada3-1eace55b0e20 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:50.468224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e55cb57a-6ce7-40a7-ada3-1eace55b0e20 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:50.468928 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e55cb57a-6ce7-40a7-ada3-1eace55b0e20 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:50.469404 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e55cb57a-6ce7-40a7-ada3-1eace55b0e20 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:50.469827 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e55cb57a-6ce7-40a7-ada3-1eace55b0e20 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:50.604490 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e55cb57a-6ce7-40a7-ada3-1eace55b0e20 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:50.612826 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-e55cb57a-6ce7-40a7-ada3-1eace55b0e20 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1502 microversion: 2.1 time: 0.157182 Aug 05 10:28:50.613496 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 217/432] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:50 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:50.635198 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8ee7a8f1-f631-40f3-9b27-0b5b539539ed tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62f21e95-f5a8-40ff-a0d2-0f0a6819eb94"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:28:50.637609 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8ee7a8f1-f631-40f3-9b27-0b5b539539ed tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:50.647077 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8ee7a8f1-f631-40f3-9b27-0b5b539539ed tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:50.647560 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8ee7a8f1-f631-40f3-9b27-0b5b539539ed tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:50.647993 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8ee7a8f1-f631-40f3-9b27-0b5b539539ed tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:50.648694 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8ee7a8f1-f631-40f3-9b27-0b5b539539ed tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:50.649145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8ee7a8f1-f631-40f3-9b27-0b5b539539ed tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:50.649566 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8ee7a8f1-f631-40f3-9b27-0b5b539539ed tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:50.672799 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-8ee7a8f1-f631-40f3-9b27-0b5b539539ed tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] HTTP exception thrown: Cannot 'attach_volume' instance 5ffbb1e1-7319-4e06-8218-45198955c4fc while it is in vm_state rescued Aug 05 10:28:50.674871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8ee7a8f1-f631-40f3-9b27-0b5b539539ed tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Request method failure captured: Aug 05 10:28:50.674871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: POST /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc/os-volume_attachments HTTP/1.1 Aug 05 10:28:50.674871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:28:50.674871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:28:50.674871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:28:50.674871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 74 Aug 05 10:28:50.674871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:28:50.674871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:28:50.674871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:28:50.674871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:28:50.674871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PBLDFW-X3TEawahF022LKFEKV68Ad6QHuGA8zjD7iptWxegCnn7NLZ93P_TTqy3qTfPaJgoXQW6RoMmhvpe8LOMj4ugeXgyBba8RW5T7FaRUqiQbD8fVKZKJ6l7h0zXL8SVOmIKhkBmKk6oIc4sQHq4LfBFKZWadDD9oZ1zaftUols Aug 05 10:28:50.674871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:28:50.674871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:28:50.674871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:28:50.674871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:28:50.674871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:28:50.674871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:28:50.674871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 9ea83951557a48fcaab832aea2273453 Aug 05 10:28:50.674871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-739497926 Aug 05 10:28:50.674871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:28:50.674871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:28:50.676241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9ea83951557a48fcaab832aea2273453"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9ea83951557a48fcaab832aea2273453"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ea83951557a48fcaab832aea2273453"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ea83951557a48fcaab832aea2273453"}]}] Aug 05 10:28:50.676241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-ServerRescueNegativeTestJSON-739497926 Aug 05 10:28:50.676241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 9ea83951557a48fcaab832aea2273453 Aug 05 10:28:50.676241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-739497926 Aug 05 10:28:50.676241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-ServerRescueNegativeTestJSON-739497926-project Aug 05 10:28:50.676241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:28:50.676241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:28:50.676241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: a3b4d90bcfc34d2d9ba1c40316e09858 Aug 05 10:28:50.676241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-ServerRescueNegativeTestJSON-739497926-project Aug 05 10:28:50.676241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Aug 05 10:28:50.676241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {"volumeAttachment": {"volumeId": "62f21e95-f5a8-40ff-a0d2-0f0a6819eb94"}} Aug 05 10:28:50.676241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:28:50.677479 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Cannot 'attach_volume' instance 5ffbb1e1-7319-4e06-8218-45198955c4fc while it is in vm_state rescued Aug 05 10:28:50.677479 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'server_id': '5ffbb1e1-7319-4e06-8218-45198955c4fc', 'body': {'volumeAttachment': {'volumeId': '62f21e95-f5a8-40ff-a0d2-0f0a6819eb94'}}} Aug 05 10:28:50.677479 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:28:50.677479 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:28:50.677479 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 10:28:50.677479 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 10:28:50.677479 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 10:28:50.677479 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 10:28:50.677479 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 05 10:28:50.677479 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 05 10:28:50.677479 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5ffbb1e1-7319-4e06-8218-45198955c4fc in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 05 10:28:50.677479 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:28:50.677479 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:28:50.677479 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:28:50.677479 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:28:50.677479 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:28:50.677479 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:28:50.677479 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:28:50.677479 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:28:50.678712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:28:50.678712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:28:50.678712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 10:28:50.678712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 10:28:50.678712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 10:28:50.678712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 10:28:50.678712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 10:28:50.678712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 10:28:50.678712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 05 10:28:50.678712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 05 10:28:50.678712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 05 10:28:50.678712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 05 10:28:50.678712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5ffbb1e1-7319-4e06-8218-45198955c4fc while it is in vm_state rescued Aug 05 10:28:50.678712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:28:50.678712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:28:50.678712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:28:50.678712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:28:50.678712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:28:50.678712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:28:50.680035 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:28:50.680035 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:28:50.680035 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5ffbb1e1-7319-4e06-8218-45198955c4fc while it is in vm_state rescued Aug 05 10:28:50.680035 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:28:50.680035 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8ee7a8f1-f631-40f3-9b27-0b5b539539ed tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Returning 409 to user: Cannot 'attach_volume' instance 5ffbb1e1-7319-4e06-8218-45198955c4fc while it is in vm_state rescued {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:28:50.680035 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8ee7a8f1-f631-40f3-9b27-0b5b539539ed tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "POST /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045788 Aug 05 10:28:50.680035 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 216/433] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 10:28:50 2022] POST /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 05 10:28:50.685718 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-7c37c2eb-8d68-4aa5-a297-50882ff31ec4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:28:50.686247 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-7c37c2eb-8d68-4aa5-a297-50882ff31ec4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:50.692688 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7c37c2eb-8d68-4aa5-a297-50882ff31ec4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:50.693456 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7c37c2eb-8d68-4aa5-a297-50882ff31ec4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:50.693900 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7c37c2eb-8d68-4aa5-a297-50882ff31ec4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:50.694589 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7c37c2eb-8d68-4aa5-a297-50882ff31ec4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:50.695118 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7c37c2eb-8d68-4aa5-a297-50882ff31ec4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:50.695535 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7c37c2eb-8d68-4aa5-a297-50882ff31ec4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:50.767213 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-7c37c2eb-8d68-4aa5-a297-50882ff31ec4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "POST /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc/action" status: 202 len: 0 microversion: 2.1 time: 0.085090 Aug 05 10:28:50.768185 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 218/434] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 10:28:50 2022] POST /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:28:50.776543 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a8e9c9c3-f3e6-40fb-9864-2e785124fc4f tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:50.777161 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a8e9c9c3-f3e6-40fb-9864-2e785124fc4f tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:50.783490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8e9c9c3-f3e6-40fb-9864-2e785124fc4f tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:50.784338 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8e9c9c3-f3e6-40fb-9864-2e785124fc4f tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:50.784794 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8e9c9c3-f3e6-40fb-9864-2e785124fc4f tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:50.785504 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8e9c9c3-f3e6-40fb-9864-2e785124fc4f tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:50.786082 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8e9c9c3-f3e6-40fb-9864-2e785124fc4f tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:50.786629 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8e9c9c3-f3e6-40fb-9864-2e785124fc4f tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:50.790942 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:28:50.918178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a8e9c9c3-f3e6-40fb-9864-2e785124fc4f tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:50.925908 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a8e9c9c3-f3e6-40fb-9864-2e785124fc4f tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1510 microversion: 2.1 time: 0.153266 Aug 05 10:28:50.926590 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 217/435] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:50 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:51.306098 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-843af9e4-1012-4794-bba9-b627c7d895ef tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:51.306871 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-843af9e4-1012-4794-bba9-b627c7d895ef tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 45eeb821-0eca-4aac-9bfa-7abf8340adbe] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:51.313335 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-843af9e4-1012-4794-bba9-b627c7d895ef tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:51.313809 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-843af9e4-1012-4794-bba9-b627c7d895ef tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:51.314460 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-843af9e4-1012-4794-bba9-b627c7d895ef tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:51.315192 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-843af9e4-1012-4794-bba9-b627c7d895ef tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:51.315646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-843af9e4-1012-4794-bba9-b627c7d895ef tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:51.316077 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-843af9e4-1012-4794-bba9-b627c7d895ef tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:51.395056 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-843af9e4-1012-4794-bba9-b627c7d895ef tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:51.403761 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-843af9e4-1012-4794-bba9-b627c7d895ef tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe" status: 200 len: 1217 microversion: 2.1 time: 0.101937 Aug 05 10:28:51.414936 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 219/436] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:51 2022] GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:51.949589 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b2b6dcce-e811-46f3-915e-6e0332362255 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:51.950233 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b2b6dcce-e811-46f3-915e-6e0332362255 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:51.953430 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:28:51.960692 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2b6dcce-e811-46f3-915e-6e0332362255 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:51.961208 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2b6dcce-e811-46f3-915e-6e0332362255 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:51.961631 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2b6dcce-e811-46f3-915e-6e0332362255 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:51.962355 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2b6dcce-e811-46f3-915e-6e0332362255 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:51.962820 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2b6dcce-e811-46f3-915e-6e0332362255 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:51.963261 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2b6dcce-e811-46f3-915e-6e0332362255 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:52.106938 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b2b6dcce-e811-46f3-915e-6e0332362255 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:52.116461 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b2b6dcce-e811-46f3-915e-6e0332362255 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1510 microversion: 2.1 time: 0.171935 Aug 05 10:28:52.118265 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 218/437] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:51 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:52.236329 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-0da1a4ae-8299-4e78-9186-4dde74231cfd tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:52.237657 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-0da1a4ae-8299-4e78-9186-4dde74231cfd tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:52.245414 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0da1a4ae-8299-4e78-9186-4dde74231cfd tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:52.246147 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0da1a4ae-8299-4e78-9186-4dde74231cfd tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:52.246668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0da1a4ae-8299-4e78-9186-4dde74231cfd tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:52.247501 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0da1a4ae-8299-4e78-9186-4dde74231cfd tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:52.248017 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0da1a4ae-8299-4e78-9186-4dde74231cfd tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:52.248498 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0da1a4ae-8299-4e78-9186-4dde74231cfd tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:52.426273 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e72198ad-4154-4cb6-87d1-9088ebcb169c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:52.427499 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e72198ad-4154-4cb6-87d1-9088ebcb169c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 45eeb821-0eca-4aac-9bfa-7abf8340adbe] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:52.434143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e72198ad-4154-4cb6-87d1-9088ebcb169c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:52.434747 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e72198ad-4154-4cb6-87d1-9088ebcb169c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:52.435298 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e72198ad-4154-4cb6-87d1-9088ebcb169c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:52.435998 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e72198ad-4154-4cb6-87d1-9088ebcb169c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:52.436544 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e72198ad-4154-4cb6-87d1-9088ebcb169c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:52.437126 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e72198ad-4154-4cb6-87d1-9088ebcb169c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:52.510659 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e72198ad-4154-4cb6-87d1-9088ebcb169c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:52.518005 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e72198ad-4154-4cb6-87d1-9088ebcb169c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe" status: 200 len: 1271 microversion: 2.1 time: 0.095904 Aug 05 10:28:52.518561 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 219/438] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:52 2022] GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe => generated 1271 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:52.639953 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-0da1a4ae-8299-4e78-9186-4dde74231cfd tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:52.648234 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-0da1a4ae-8299-4e78-9186-4dde74231cfd tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1593 microversion: 2.1 time: 0.415885 Aug 05 10:28:52.649919 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 220/439] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:52 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1593 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:53.140030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9393195f-8280-4536-bbc1-9fcf2e48bcf7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:53.142035 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9393195f-8280-4536-bbc1-9fcf2e48bcf7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:53.150227 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9393195f-8280-4536-bbc1-9fcf2e48bcf7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:53.163701 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9393195f-8280-4536-bbc1-9fcf2e48bcf7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:53.164482 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9393195f-8280-4536-bbc1-9fcf2e48bcf7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:53.165457 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9393195f-8280-4536-bbc1-9fcf2e48bcf7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:53.165650 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9393195f-8280-4536-bbc1-9fcf2e48bcf7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:53.166203 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9393195f-8280-4536-bbc1-9fcf2e48bcf7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:53.318777 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9393195f-8280-4536-bbc1-9fcf2e48bcf7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:53.328086 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9393195f-8280-4536-bbc1-9fcf2e48bcf7 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1510 microversion: 2.1 time: 0.194492 Aug 05 10:28:53.330934 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 220/440] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:53 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:53.539517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f6d29121-a4ad-45ff-9abb-02924568640c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:53.541254 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f6d29121-a4ad-45ff-9abb-02924568640c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 45eeb821-0eca-4aac-9bfa-7abf8340adbe] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:53.548465 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f6d29121-a4ad-45ff-9abb-02924568640c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:53.549581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f6d29121-a4ad-45ff-9abb-02924568640c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:53.550168 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f6d29121-a4ad-45ff-9abb-02924568640c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:53.551035 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f6d29121-a4ad-45ff-9abb-02924568640c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:53.551505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f6d29121-a4ad-45ff-9abb-02924568640c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:53.552135 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f6d29121-a4ad-45ff-9abb-02924568640c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:53.793951 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-f6d29121-a4ad-45ff-9abb-02924568640c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:53.801880 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f6d29121-a4ad-45ff-9abb-02924568640c tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe" status: 200 len: 1313 microversion: 2.1 time: 0.266566 Aug 05 10:28:53.803177 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 221/441] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:53 2022] GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:54.350586 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8ae6eca8-42f2-4c67-8315-dd5deb2584aa tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:54.352231 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8ae6eca8-42f2-4c67-8315-dd5deb2584aa tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:54.360346 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8ae6eca8-42f2-4c67-8315-dd5deb2584aa tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:54.361102 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8ae6eca8-42f2-4c67-8315-dd5deb2584aa tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:54.361540 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8ae6eca8-42f2-4c67-8315-dd5deb2584aa tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:54.362239 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8ae6eca8-42f2-4c67-8315-dd5deb2584aa tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:54.362709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8ae6eca8-42f2-4c67-8315-dd5deb2584aa tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:54.363159 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8ae6eca8-42f2-4c67-8315-dd5deb2584aa tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:54.539010 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8ae6eca8-42f2-4c67-8315-dd5deb2584aa tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:54.547446 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8ae6eca8-42f2-4c67-8315-dd5deb2584aa tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1510 microversion: 2.1 time: 0.201752 Aug 05 10:28:54.548056 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 221/442] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:54 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:54.825887 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-a106005e-1c28-4183-8c27-e0e47551c02a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:54.825887 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-a106005e-1c28-4183-8c27-e0e47551c02a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 45eeb821-0eca-4aac-9bfa-7abf8340adbe] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:54.833460 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a106005e-1c28-4183-8c27-e0e47551c02a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:54.833993 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a106005e-1c28-4183-8c27-e0e47551c02a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:54.834444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a106005e-1c28-4183-8c27-e0e47551c02a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:54.835541 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a106005e-1c28-4183-8c27-e0e47551c02a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:54.836249 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a106005e-1c28-4183-8c27-e0e47551c02a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:54.837113 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a106005e-1c28-4183-8c27-e0e47551c02a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:55.395568 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a106005e-1c28-4183-8c27-e0e47551c02a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:55.415827 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-91122b2e-5ee6-4067-ac7f-a7cfffd74ac7 req-678c4c52-2577-428d-9daa-603d922fc23a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08e86ee6-2452-4827-aff1-651395a4a8dc", "tag": "281bc44c-dd54-4a8e-b7a3-049f2bdcf803"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:28:55.419421 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-a106005e-1c28-4183-8c27-e0e47551c02a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe" status: 200 len: 1313 microversion: 2.1 time: 0.599220 Aug 05 10:28:55.420006 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 222/443] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:54 2022] GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe => generated 1313 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:55.430115 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-91122b2e-5ee6-4067-ac7f-a7cfffd74ac7 req-678c4c52-2577-428d-9daa-603d922fc23a service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:55.430597 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-91122b2e-5ee6-4067-ac7f-a7cfffd74ac7 req-678c4c52-2577-428d-9daa-603d922fc23a service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:55.431139 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-91122b2e-5ee6-4067-ac7f-a7cfffd74ac7 req-678c4c52-2577-428d-9daa-603d922fc23a service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:55.467521 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-91122b2e-5ee6-4067-ac7f-a7cfffd74ac7 req-678c4c52-2577-428d-9daa-603d922fc23a service nova] Creating event network-changed:281bc44c-dd54-4a8e-b7a3-049f2bdcf803 for instance 08e86ee6-2452-4827-aff1-651395a4a8dc on hv-cinder-81558 Aug 05 10:28:55.478483 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-91122b2e-5ee6-4067-ac7f-a7cfffd74ac7 req-678c4c52-2577-428d-9daa-603d922fc23a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066055 Aug 05 10:28:55.479173 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 222/444] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:28:55.570763 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-da97d0c0-861e-440c-a966-d024f9dcb55e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:55.572676 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-da97d0c0-861e-440c-a966-d024f9dcb55e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:55.585642 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-da97d0c0-861e-440c-a966-d024f9dcb55e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:55.587056 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-da97d0c0-861e-440c-a966-d024f9dcb55e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:55.588115 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-da97d0c0-861e-440c-a966-d024f9dcb55e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:55.589077 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-da97d0c0-861e-440c-a966-d024f9dcb55e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:55.589692 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-da97d0c0-861e-440c-a966-d024f9dcb55e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:55.590462 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-da97d0c0-861e-440c-a966-d024f9dcb55e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:55.900462 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-da97d0c0-861e-440c-a966-d024f9dcb55e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:55.911220 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-da97d0c0-861e-440c-a966-d024f9dcb55e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1510 microversion: 2.1 time: 0.346060 Aug 05 10:28:55.912249 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 223/445] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:55 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1510 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:56.444365 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b5a83c74-92a0-4ae0-b639-e627dca51044 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:56.445338 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b5a83c74-92a0-4ae0-b639-e627dca51044 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 45eeb821-0eca-4aac-9bfa-7abf8340adbe] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:56.465619 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b5a83c74-92a0-4ae0-b639-e627dca51044 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:56.467084 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b5a83c74-92a0-4ae0-b639-e627dca51044 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:56.468136 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b5a83c74-92a0-4ae0-b639-e627dca51044 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:56.469838 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b5a83c74-92a0-4ae0-b639-e627dca51044 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:56.470461 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b5a83c74-92a0-4ae0-b639-e627dca51044 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:56.471014 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b5a83c74-92a0-4ae0-b639-e627dca51044 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:56.702969 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b5a83c74-92a0-4ae0-b639-e627dca51044 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:56.714668 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b5a83c74-92a0-4ae0-b639-e627dca51044 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe" status: 200 len: 1313 microversion: 2.1 time: 0.276670 Aug 05 10:28:56.715945 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 223/446] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:56 2022] GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:56.799320 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-10d4a3f8-c312-4b5e-8c3f-7ea2f2b4124b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-420058493"}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:28:56.800088 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-10d4a3f8-c312-4b5e-8c3f-7ea2f2b4124b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:56.806512 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-10d4a3f8-c312-4b5e-8c3f-7ea2f2b4124b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:56.807254 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-10d4a3f8-c312-4b5e-8c3f-7ea2f2b4124b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:56.807738 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-10d4a3f8-c312-4b5e-8c3f-7ea2f2b4124b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:56.808699 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-10d4a3f8-c312-4b5e-8c3f-7ea2f2b4124b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:56.809165 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-10d4a3f8-c312-4b5e-8c3f-7ea2f2b4124b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:56.809586 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-10d4a3f8-c312-4b5e-8c3f-7ea2f2b4124b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:56.934142 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c1d4ea27-c2a5-4bc4-adab-e7d527c860b4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:56.935094 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c1d4ea27-c2a5-4bc4-adab-e7d527c860b4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:56.941338 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c1d4ea27-c2a5-4bc4-adab-e7d527c860b4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:56.941840 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c1d4ea27-c2a5-4bc4-adab-e7d527c860b4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:56.942426 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c1d4ea27-c2a5-4bc4-adab-e7d527c860b4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:56.943667 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c1d4ea27-c2a5-4bc4-adab-e7d527c860b4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:56.944178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c1d4ea27-c2a5-4bc4-adab-e7d527c860b4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:56.944598 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c1d4ea27-c2a5-4bc4-adab-e7d527c860b4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:57.101910 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c1d4ea27-c2a5-4bc4-adab-e7d527c860b4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:57.109781 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c1d4ea27-c2a5-4bc4-adab-e7d527c860b4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1516 microversion: 2.1 time: 0.179837 Aug 05 10:28:57.110780 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 224/447] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:56 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:28:57.198483 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.network.security_group_api [None req-10d4a3f8-c312-4b5e-8c3f-7ea2f2b4124b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Adding security group 859e5cea-276e-479e-9104-ebfafd9628d3 to port 281bc44c-dd54-4a8e-b7a3-049f2bdcf803 Aug 05 10:28:57.507489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-f15ad319-6ee7-4274-a209-eb05bd54a2d5 req-44c8d271-4eb3-49d4-a4b8-4d8780669b2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45eeb821-0eca-4aac-9bfa-7abf8340adbe", "tag": "527e35d3-4e12-43f4-bdcc-a360a0dc21a0"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:28:57.518876 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-f15ad319-6ee7-4274-a209-eb05bd54a2d5 req-44c8d271-4eb3-49d4-a4b8-4d8780669b2f service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:57.519374 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-f15ad319-6ee7-4274-a209-eb05bd54a2d5 req-44c8d271-4eb3-49d4-a4b8-4d8780669b2f service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:57.519797 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-f15ad319-6ee7-4274-a209-eb05bd54a2d5 req-44c8d271-4eb3-49d4-a4b8-4d8780669b2f service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:57.532422 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-f15ad319-6ee7-4274-a209-eb05bd54a2d5 req-44c8d271-4eb3-49d4-a4b8-4d8780669b2f service nova] Creating event network-changed:527e35d3-4e12-43f4-bdcc-a360a0dc21a0 for instance 45eeb821-0eca-4aac-9bfa-7abf8340adbe on hv-cinder-81558 Aug 05 10:28:57.537509 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-f15ad319-6ee7-4274-a209-eb05bd54a2d5 req-44c8d271-4eb3-49d4-a4b8-4d8780669b2f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034143 Aug 05 10:28:57.538106 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 225/448] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:28:57.740092 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-73850c5d-1bbb-4cc5-bfda-ad7dcb2807fb tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:57.740787 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-73850c5d-1bbb-4cc5-bfda-ad7dcb2807fb tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 45eeb821-0eca-4aac-9bfa-7abf8340adbe] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:57.748463 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73850c5d-1bbb-4cc5-bfda-ad7dcb2807fb tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:57.748942 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73850c5d-1bbb-4cc5-bfda-ad7dcb2807fb tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:57.749371 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73850c5d-1bbb-4cc5-bfda-ad7dcb2807fb tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:57.750237 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73850c5d-1bbb-4cc5-bfda-ad7dcb2807fb tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:57.750829 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73850c5d-1bbb-4cc5-bfda-ad7dcb2807fb tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:57.751843 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73850c5d-1bbb-4cc5-bfda-ad7dcb2807fb tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:57.780318 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-10d4a3f8-c312-4b5e-8c3f-7ea2f2b4124b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "POST /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc/action" status: 202 len: 0 microversion: 2.1 time: 0.984967 Aug 05 10:28:57.784838 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 224/449] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 10:28:56 2022] POST /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc/action => generated 0 bytes in 990 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 10:28:57.790016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ef075265-f128-4344-acb8-1ffcfe0bd995 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:57.790762 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-ef075265-f128-4344-acb8-1ffcfe0bd995 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:57.800494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ef075265-f128-4344-acb8-1ffcfe0bd995 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:57.801234 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ef075265-f128-4344-acb8-1ffcfe0bd995 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:57.801721 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ef075265-f128-4344-acb8-1ffcfe0bd995 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:57.802629 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ef075265-f128-4344-acb8-1ffcfe0bd995 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:57.803147 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ef075265-f128-4344-acb8-1ffcfe0bd995 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:57.803683 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ef075265-f128-4344-acb8-1ffcfe0bd995 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:57.935274 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-73850c5d-1bbb-4cc5-bfda-ad7dcb2807fb tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:57.947680 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-73850c5d-1bbb-4cc5-bfda-ad7dcb2807fb tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe" status: 200 len: 1313 microversion: 2.1 time: 0.212020 Aug 05 10:28:57.948286 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 226/450] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:57 2022] GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:28:57.993568 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ef075265-f128-4344-acb8-1ffcfe0bd995 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:57.997637 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:28:58.002934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ef075265-f128-4344-acb8-1ffcfe0bd995 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1757 microversion: 2.1 time: 0.216938 Aug 05 10:28:58.003499 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 225/451] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:57 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1757 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:58.511450 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-298992c7-ad16-46fd-be41-4d69630db617 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Action: 'create', calling method: .version_select at 0x7f7327708820>, body: {"keypair": {"name": "tempest-keypair-691803767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv7nLKsoa9UnnWtjh0NezMbvLqVTATm8oTHXB1+LF25D5R7vSTgm+f+ub5JczdGtpqm+CQ5raeTVLCQvP2pjWRhRfRfJ7QhCw/sUzRNHg0dRPA/Ff65znqSOt2uvc1pig=="}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:28:58.528124 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-298992c7-ad16-46fd-be41-4d69630db617 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Getting quotas for project 9ea83951557a48fcaab832aea2273453. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:28:58.532287 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-298992c7-ad16-46fd-be41-4d69630db617 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Getting quotas for user a3b4d90bcfc34d2d9ba1c40316e09858 and project 9ea83951557a48fcaab832aea2273453. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:28:58.556266 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-298992c7-ad16-46fd-be41-4d69630db617 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048795 Aug 05 10:28:58.557243 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 227/452] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 5 10:28:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:28:58.969458 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-15cafd8e-c2e7-4af3-b104-6fdc4edeeb3b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:28:58.970667 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-15cafd8e-c2e7-4af3-b104-6fdc4edeeb3b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 45eeb821-0eca-4aac-9bfa-7abf8340adbe] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:28:58.981199 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-15cafd8e-c2e7-4af3-b104-6fdc4edeeb3b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:58.983014 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-15cafd8e-c2e7-4af3-b104-6fdc4edeeb3b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:58.983673 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-15cafd8e-c2e7-4af3-b104-6fdc4edeeb3b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:58.985660 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-15cafd8e-c2e7-4af3-b104-6fdc4edeeb3b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:58.986358 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-15cafd8e-c2e7-4af3-b104-6fdc4edeeb3b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:58.987379 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-15cafd8e-c2e7-4af3-b104-6fdc4edeeb3b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:59.179061 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-15cafd8e-c2e7-4af3-b104-6fdc4edeeb3b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:28:59.187474 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-15cafd8e-c2e7-4af3-b104-6fdc4edeeb3b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe" status: 200 len: 1313 microversion: 2.1 time: 0.223092 Aug 05 10:28:59.188050 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 226/453] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:28:58 2022] GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:28:59.553552 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-1efa1762-4f0e-4bd9-8ae6-bcf49bedf986 req-76925551-2f21-4b73-834e-7d16131f0446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08e86ee6-2452-4827-aff1-651395a4a8dc", "tag": "281bc44c-dd54-4a8e-b7a3-049f2bdcf803"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:28:59.564237 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-1efa1762-4f0e-4bd9-8ae6-bcf49bedf986 req-76925551-2f21-4b73-834e-7d16131f0446 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:28:59.564992 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-1efa1762-4f0e-4bd9-8ae6-bcf49bedf986 req-76925551-2f21-4b73-834e-7d16131f0446 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:28:59.565606 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-1efa1762-4f0e-4bd9-8ae6-bcf49bedf986 req-76925551-2f21-4b73-834e-7d16131f0446 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:28:59.577946 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-1efa1762-4f0e-4bd9-8ae6-bcf49bedf986 req-76925551-2f21-4b73-834e-7d16131f0446 service nova] Creating event network-changed:281bc44c-dd54-4a8e-b7a3-049f2bdcf803 for instance 08e86ee6-2452-4827-aff1-651395a4a8dc on hv-cinder-81558 Aug 05 10:28:59.583555 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-1efa1762-4f0e-4bd9-8ae6-bcf49bedf986 req-76925551-2f21-4b73-834e-7d16131f0446 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033880 Aug 05 10:28:59.584397 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 228/454] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:29:00.209783 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ec72d4e4-08f5-44d6-9220-d2413b000d3e tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:00.210384 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-ec72d4e4-08f5-44d6-9220-d2413b000d3e tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 45eeb821-0eca-4aac-9bfa-7abf8340adbe] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:00.212847 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=2 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:29:00.213470 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=6 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:29:00.214445 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:29:00.220694 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ec72d4e4-08f5-44d6-9220-d2413b000d3e tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:00.221183 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ec72d4e4-08f5-44d6-9220-d2413b000d3e tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:00.221613 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ec72d4e4-08f5-44d6-9220-d2413b000d3e tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:00.222321 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ec72d4e4-08f5-44d6-9220-d2413b000d3e tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:00.222765 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ec72d4e4-08f5-44d6-9220-d2413b000d3e tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:00.223220 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ec72d4e4-08f5-44d6-9220-d2413b000d3e tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:00.372549 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ec72d4e4-08f5-44d6-9220-d2413b000d3e tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:00.381275 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ec72d4e4-08f5-44d6-9220-d2413b000d3e tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe" status: 200 len: 1313 microversion: 2.1 time: 0.175749 Aug 05 10:29:00.382174 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 227/455] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:00 2022] GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:00.873089 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b10ad82c-e984-48bb-9017-b9050775d832 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1836483001", "imageRef": "6163bb7c-dfd7-4fb1-a3cb-9f4818243f78", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ebe6c2c-594f-404c-8238-583b3492b7a1"}], "security_groups": [{"name": "tempest-securitygroup--1512492400"}], "key_name": "tempest-keypair-691803767", "user_data": "}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:29:01.128320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-b10ad82c-e984-48bb-9017-b9050775d832 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] validate_networks() for [('0ebe6c2c-594f-404c-8238-583b3492b7a1', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 10:29:01.403774 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-82fdbcff-9e98-4ce8-b3cc-cc9d2e868564 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:01.405131 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-82fdbcff-9e98-4ce8-b3cc-cc9d2e868564 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 45eeb821-0eca-4aac-9bfa-7abf8340adbe] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:01.413461 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-82fdbcff-9e98-4ce8-b3cc-cc9d2e868564 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:01.414377 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-82fdbcff-9e98-4ce8-b3cc-cc9d2e868564 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:01.415034 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-82fdbcff-9e98-4ce8-b3cc-cc9d2e868564 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:01.415961 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-82fdbcff-9e98-4ce8-b3cc-cc9d2e868564 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:01.416689 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-82fdbcff-9e98-4ce8-b3cc-cc9d2e868564 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:01.417311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-82fdbcff-9e98-4ce8-b3cc-cc9d2e868564 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:01.701336 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-b10ad82c-e984-48bb-9017-b9050775d832 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 10:29:01.702184 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-b10ad82c-e984-48bb-9017-b9050775d832 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 10:29:01.702818 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-b10ad82c-e984-48bb-9017-b9050775d832 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 10:29:01.703248 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-b10ad82c-e984-48bb-9017-b9050775d832 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 10:29:01.703817 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-b10ad82c-e984-48bb-9017-b9050775d832 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 10:29:01.714552 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b10ad82c-e984-48bb-9017-b9050775d832 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:01.715053 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b10ad82c-e984-48bb-9017-b9050775d832 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:01.715923 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b10ad82c-e984-48bb-9017-b9050775d832 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:01.716827 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b10ad82c-e984-48bb-9017-b9050775d832 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:01.717285 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b10ad82c-e984-48bb-9017-b9050775d832 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:01.717704 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b10ad82c-e984-48bb-9017-b9050775d832 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:01.738514 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-b10ad82c-e984-48bb-9017-b9050775d832 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Getting quotas for project 9ea83951557a48fcaab832aea2273453. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:29:01.742919 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-b10ad82c-e984-48bb-9017-b9050775d832 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Getting quotas for user a3b4d90bcfc34d2d9ba1c40316e09858 and project 9ea83951557a48fcaab832aea2273453. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:29:01.755268 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b10ad82c-e984-48bb-9017-b9050775d832 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 10:29:01.758576 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b10ad82c-e984-48bb-9017-b9050775d832 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6163bb7c-dfd7-4fb1-a3cb-9f4818243f78',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 10:29:01.808552 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-82fdbcff-9e98-4ce8-b3cc-cc9d2e868564 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:01.811876 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b10ad82c-e984-48bb-9017-b9050775d832 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.947722 Aug 05 10:29:01.813121 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 229/456] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 10:29:00 2022] POST /compute/v2.1/servers => generated 409 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 10:29:01.822039 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-82fdbcff-9e98-4ce8-b3cc-cc9d2e868564 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe" status: 200 len: 1313 microversion: 2.1 time: 0.423172 Aug 05 10:29:01.823824 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e59e9f01-1103-4bfd-81a3-f6816154efa8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:01.824173 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 228/457] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:01 2022] GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:01.825071 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e59e9f01-1103-4bfd-81a3-f6816154efa8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:01.901379 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e59e9f01-1103-4bfd-81a3-f6816154efa8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:01.910341 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e59e9f01-1103-4bfd-81a3-f6816154efa8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1245 microversion: 2.1 time: 0.090566 Aug 05 10:29:01.913745 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 230/458] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:01 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:29:02.843779 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-3c491ce1-fdc0-4bda-8843-ae7f6cd21d21 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:02.844333 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-3c491ce1-fdc0-4bda-8843-ae7f6cd21d21 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 45eeb821-0eca-4aac-9bfa-7abf8340adbe] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:02.851641 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3c491ce1-fdc0-4bda-8843-ae7f6cd21d21 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:02.852381 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3c491ce1-fdc0-4bda-8843-ae7f6cd21d21 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:02.852991 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3c491ce1-fdc0-4bda-8843-ae7f6cd21d21 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:02.853863 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3c491ce1-fdc0-4bda-8843-ae7f6cd21d21 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:02.854487 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3c491ce1-fdc0-4bda-8843-ae7f6cd21d21 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:02.855115 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3c491ce1-fdc0-4bda-8843-ae7f6cd21d21 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:02.933743 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f205db1a-3aef-49d4-8f6c-3bc86835d966 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:02.935098 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f205db1a-3aef-49d4-8f6c-3bc86835d966 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:02.942920 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f205db1a-3aef-49d4-8f6c-3bc86835d966 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:02.943809 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f205db1a-3aef-49d4-8f6c-3bc86835d966 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:02.944279 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f205db1a-3aef-49d4-8f6c-3bc86835d966 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:02.945374 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f205db1a-3aef-49d4-8f6c-3bc86835d966 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:02.946071 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f205db1a-3aef-49d4-8f6c-3bc86835d966 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:02.946562 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f205db1a-3aef-49d4-8f6c-3bc86835d966 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:03.035742 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f205db1a-3aef-49d4-8f6c-3bc86835d966 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:03.044728 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f205db1a-3aef-49d4-8f6c-3bc86835d966 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1297 microversion: 2.1 time: 0.115065 Aug 05 10:29:03.060709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 231/459] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:02 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1297 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:29:03.105091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-3c491ce1-fdc0-4bda-8843-ae7f6cd21d21 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:03.115153 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-3c491ce1-fdc0-4bda-8843-ae7f6cd21d21 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe" status: 200 len: 1313 microversion: 2.1 time: 0.275164 Aug 05 10:29:03.115744 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 229/460] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:02 2022] GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:03.996989 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-81624825-a1f9-44aa-a169-1a96b7ca55b9 req-5c44d01c-d220-4486-a861-2322492e702d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45eeb821-0eca-4aac-9bfa-7abf8340adbe", "name": "network-vif-plugged", "status": "completed", "tag": "527e35d3-4e12-43f4-bdcc-a360a0dc21a0"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:29:04.013237 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-81624825-a1f9-44aa-a169-1a96b7ca55b9 req-5c44d01c-d220-4486-a861-2322492e702d service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:04.013933 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-81624825-a1f9-44aa-a169-1a96b7ca55b9 req-5c44d01c-d220-4486-a861-2322492e702d service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:04.014702 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-81624825-a1f9-44aa-a169-1a96b7ca55b9 req-5c44d01c-d220-4486-a861-2322492e702d service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:04.029717 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-81624825-a1f9-44aa-a169-1a96b7ca55b9 req-5c44d01c-d220-4486-a861-2322492e702d service nova] Creating event network-vif-plugged:527e35d3-4e12-43f4-bdcc-a360a0dc21a0 for instance 45eeb821-0eca-4aac-9bfa-7abf8340adbe on hv-cinder-81558 Aug 05 10:29:04.043092 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-81624825-a1f9-44aa-a169-1a96b7ca55b9 req-5c44d01c-d220-4486-a861-2322492e702d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049694 Aug 05 10:29:04.044296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 232/461] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:29:04.068921 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b703afff-03f1-43fb-9ab8-c14ba722f332 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:04.069542 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b703afff-03f1-43fb-9ab8-c14ba722f332 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:04.080048 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b703afff-03f1-43fb-9ab8-c14ba722f332 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:04.081072 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b703afff-03f1-43fb-9ab8-c14ba722f332 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:04.081748 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b703afff-03f1-43fb-9ab8-c14ba722f332 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:04.082710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b703afff-03f1-43fb-9ab8-c14ba722f332 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:04.083381 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b703afff-03f1-43fb-9ab8-c14ba722f332 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:04.084037 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b703afff-03f1-43fb-9ab8-c14ba722f332 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:04.137740 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-afa22241-9f8d-4fb6-a7c3-7f529cff3528 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:04.138664 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-afa22241-9f8d-4fb6-a7c3-7f529cff3528 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 45eeb821-0eca-4aac-9bfa-7abf8340adbe] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:04.146155 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afa22241-9f8d-4fb6-a7c3-7f529cff3528 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:04.146997 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afa22241-9f8d-4fb6-a7c3-7f529cff3528 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:04.147643 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afa22241-9f8d-4fb6-a7c3-7f529cff3528 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:04.148519 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afa22241-9f8d-4fb6-a7c3-7f529cff3528 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:04.149117 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afa22241-9f8d-4fb6-a7c3-7f529cff3528 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:04.149959 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afa22241-9f8d-4fb6-a7c3-7f529cff3528 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:04.208356 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b703afff-03f1-43fb-9ab8-c14ba722f332 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:04.224069 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b703afff-03f1-43fb-9ab8-c14ba722f332 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1303 microversion: 2.1 time: 0.158152 Aug 05 10:29:04.243656 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 230/462] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:04 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1303 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:04.310843 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-afa22241-9f8d-4fb6-a7c3-7f529cff3528 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:04.319534 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-afa22241-9f8d-4fb6-a7c3-7f529cff3528 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe" status: 200 len: 1313 microversion: 2.1 time: 0.186273 Aug 05 10:29:04.320804 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 233/463] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:04 2022] GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:29:05.253048 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-7bd7de34-6bc1-44e1-b40b-ab7ba5586d29 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:05.253674 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-7bd7de34-6bc1-44e1-b40b-ab7ba5586d29 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:05.260962 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7bd7de34-6bc1-44e1-b40b-ab7ba5586d29 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:05.262546 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7bd7de34-6bc1-44e1-b40b-ab7ba5586d29 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:05.263196 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7bd7de34-6bc1-44e1-b40b-ab7ba5586d29 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:05.264426 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7bd7de34-6bc1-44e1-b40b-ab7ba5586d29 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:05.265015 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7bd7de34-6bc1-44e1-b40b-ab7ba5586d29 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:05.265602 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7bd7de34-6bc1-44e1-b40b-ab7ba5586d29 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:05.340784 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fb165e58-a57f-4b57-a338-01b90bdd7e65 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:05.341376 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fb165e58-a57f-4b57-a338-01b90bdd7e65 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 45eeb821-0eca-4aac-9bfa-7abf8340adbe] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:05.350295 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb165e58-a57f-4b57-a338-01b90bdd7e65 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:05.351279 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb165e58-a57f-4b57-a338-01b90bdd7e65 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:05.351980 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb165e58-a57f-4b57-a338-01b90bdd7e65 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:05.353940 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb165e58-a57f-4b57-a338-01b90bdd7e65 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:05.354743 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb165e58-a57f-4b57-a338-01b90bdd7e65 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:05.355398 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb165e58-a57f-4b57-a338-01b90bdd7e65 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:05.533173 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-7bd7de34-6bc1-44e1-b40b-ab7ba5586d29 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:05.551267 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-7bd7de34-6bc1-44e1-b40b-ab7ba5586d29 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1371 microversion: 2.1 time: 0.301967 Aug 05 10:29:05.552020 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 231/464] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:05 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1371 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:05.632195 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fb165e58-a57f-4b57-a338-01b90bdd7e65 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:05.646391 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fb165e58-a57f-4b57-a338-01b90bdd7e65 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe" status: 200 len: 1313 microversion: 2.1 time: 0.309406 Aug 05 10:29:05.647225 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 234/465] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:05 2022] GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:29:05.978220 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-e558ef02-79e4-4021-a6b5-21a41376480b req-6c3f602b-8772-46d8-a5e0-81db79770606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94bc927e-f379-4a93-a980-289f58af66f9", "tag": "76d42f2f-ee41-465d-bac5-77d316e82d9d"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:29:05.998615 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-e558ef02-79e4-4021-a6b5-21a41376480b req-6c3f602b-8772-46d8-a5e0-81db79770606 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:06.002045 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-e558ef02-79e4-4021-a6b5-21a41376480b req-6c3f602b-8772-46d8-a5e0-81db79770606 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:06.003629 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-e558ef02-79e4-4021-a6b5-21a41376480b req-6c3f602b-8772-46d8-a5e0-81db79770606 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:06.024952 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-e558ef02-79e4-4021-a6b5-21a41376480b req-6c3f602b-8772-46d8-a5e0-81db79770606 service nova] Creating event network-changed:76d42f2f-ee41-465d-bac5-77d316e82d9d for instance 94bc927e-f379-4a93-a980-289f58af66f9 on hv-cinder-81558 Aug 05 10:29:06.031927 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-e558ef02-79e4-4021-a6b5-21a41376480b req-6c3f602b-8772-46d8-a5e0-81db79770606 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057321 Aug 05 10:29:06.033506 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 232/466] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:29:06.573367 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9be4603e-0f8d-42a0-9821-3b0f30c9b50b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:06.573983 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9be4603e-0f8d-42a0-9821-3b0f30c9b50b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:06.581373 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9be4603e-0f8d-42a0-9821-3b0f30c9b50b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:06.581868 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9be4603e-0f8d-42a0-9821-3b0f30c9b50b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:06.582456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9be4603e-0f8d-42a0-9821-3b0f30c9b50b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:06.583363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9be4603e-0f8d-42a0-9821-3b0f30c9b50b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:06.583878 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9be4603e-0f8d-42a0-9821-3b0f30c9b50b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:06.584477 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9be4603e-0f8d-42a0-9821-3b0f30c9b50b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:06.672576 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-aa23be05-cacf-470b-9940-c124f1c82afd tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:06.674404 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-aa23be05-cacf-470b-9940-c124f1c82afd tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 45eeb821-0eca-4aac-9bfa-7abf8340adbe] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:06.681378 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aa23be05-cacf-470b-9940-c124f1c82afd tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:06.681878 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aa23be05-cacf-470b-9940-c124f1c82afd tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:06.682378 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aa23be05-cacf-470b-9940-c124f1c82afd tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:06.683124 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aa23be05-cacf-470b-9940-c124f1c82afd tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:06.683569 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aa23be05-cacf-470b-9940-c124f1c82afd tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:06.683981 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aa23be05-cacf-470b-9940-c124f1c82afd tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:06.866357 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9be4603e-0f8d-42a0-9821-3b0f30c9b50b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:06.877581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9be4603e-0f8d-42a0-9821-3b0f30c9b50b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1371 microversion: 2.1 time: 0.308946 Aug 05 10:29:06.878447 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 235/467] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:06 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1371 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:06.940129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-aa23be05-cacf-470b-9940-c124f1c82afd tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:06.953279 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-aa23be05-cacf-470b-9940-c124f1c82afd tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe" status: 200 len: 1313 microversion: 2.1 time: 0.285290 Aug 05 10:29:06.958875 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 233/468] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:06 2022] GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:29:07.899050 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-822db842-ad29-453b-baa7-f9b52147fc5b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:07.903304 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-822db842-ad29-453b-baa7-f9b52147fc5b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:07.919449 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-822db842-ad29-453b-baa7-f9b52147fc5b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:07.920395 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-822db842-ad29-453b-baa7-f9b52147fc5b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:07.921000 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-822db842-ad29-453b-baa7-f9b52147fc5b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:07.922558 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-822db842-ad29-453b-baa7-f9b52147fc5b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:07.923555 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-822db842-ad29-453b-baa7-f9b52147fc5b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:07.924151 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-822db842-ad29-453b-baa7-f9b52147fc5b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:07.980300 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ccb9cbc1-2723-459e-a609-ffd328e7f81b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:07.982189 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-ccb9cbc1-2723-459e-a609-ffd328e7f81b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 45eeb821-0eca-4aac-9bfa-7abf8340adbe] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:07.989429 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ccb9cbc1-2723-459e-a609-ffd328e7f81b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:07.992660 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ccb9cbc1-2723-459e-a609-ffd328e7f81b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:07.994020 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ccb9cbc1-2723-459e-a609-ffd328e7f81b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:07.998500 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ccb9cbc1-2723-459e-a609-ffd328e7f81b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:07.999196 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ccb9cbc1-2723-459e-a609-ffd328e7f81b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:07.999822 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ccb9cbc1-2723-459e-a609-ffd328e7f81b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:08.124137 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-822db842-ad29-453b-baa7-f9b52147fc5b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:08.133737 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-822db842-ad29-453b-baa7-f9b52147fc5b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1371 microversion: 2.1 time: 0.238720 Aug 05 10:29:08.135491 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 236/469] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:07 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:08.188975 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ccb9cbc1-2723-459e-a609-ffd328e7f81b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:08.197772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ccb9cbc1-2723-459e-a609-ffd328e7f81b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe" status: 200 len: 1497 microversion: 2.1 time: 0.221694 Aug 05 10:29:08.198420 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 234/470] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:07 2022] GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe => generated 1497 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:08.808164 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3b65b374-dde3-4e32-ad92-a88096ee527f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:08.808792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3b65b374-dde3-4e32-ad92-a88096ee527f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 45eeb821-0eca-4aac-9bfa-7abf8340adbe] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:08.815081 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b65b374-dde3-4e32-ad92-a88096ee527f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:08.815865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b65b374-dde3-4e32-ad92-a88096ee527f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:08.816518 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b65b374-dde3-4e32-ad92-a88096ee527f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:08.817527 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b65b374-dde3-4e32-ad92-a88096ee527f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:08.818221 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b65b374-dde3-4e32-ad92-a88096ee527f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:08.818695 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b65b374-dde3-4e32-ad92-a88096ee527f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:08.848511 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3b65b374-dde3-4e32-ad92-a88096ee527f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 45eeb821-0eca-4aac-9bfa-7abf8340adbe] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 10:29:08.904941 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:29:08.947555 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3b65b374-dde3-4e32-ad92-a88096ee527f tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "DELETE /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe" status: 204 len: 0 microversion: 2.1 time: 0.142562 Aug 05 10:29:08.950982 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 237/471] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:29:08 2022] DELETE /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:29:08.957613 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ca6955ec-4f4a-4b9a-b4a6-bd768c15077d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:08.958484 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-ca6955ec-4f4a-4b9a-b4a6-bd768c15077d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 45eeb821-0eca-4aac-9bfa-7abf8340adbe] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:08.966397 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ca6955ec-4f4a-4b9a-b4a6-bd768c15077d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:08.969606 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ca6955ec-4f4a-4b9a-b4a6-bd768c15077d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:08.970290 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ca6955ec-4f4a-4b9a-b4a6-bd768c15077d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:08.971305 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ca6955ec-4f4a-4b9a-b4a6-bd768c15077d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:08.971976 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ca6955ec-4f4a-4b9a-b4a6-bd768c15077d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:08.972691 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ca6955ec-4f4a-4b9a-b4a6-bd768c15077d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:09.132979 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ca6955ec-4f4a-4b9a-b4a6-bd768c15077d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:09.142715 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ca6955ec-4f4a-4b9a-b4a6-bd768c15077d tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe" status: 200 len: 1503 microversion: 2.1 time: 0.189569 Aug 05 10:29:09.144006 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 235/472] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:08 2022] GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe => generated 1503 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:09.165106 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-aa0abfac-cfd0-42fb-b86c-90b7ce7f5554 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:09.166061 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-aa0abfac-cfd0-42fb-b86c-90b7ce7f5554 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:09.173094 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aa0abfac-cfd0-42fb-b86c-90b7ce7f5554 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:09.173960 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aa0abfac-cfd0-42fb-b86c-90b7ce7f5554 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:09.174656 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aa0abfac-cfd0-42fb-b86c-90b7ce7f5554 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:09.176593 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aa0abfac-cfd0-42fb-b86c-90b7ce7f5554 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:09.177309 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aa0abfac-cfd0-42fb-b86c-90b7ce7f5554 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:09.177969 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aa0abfac-cfd0-42fb-b86c-90b7ce7f5554 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:09.375872 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-aa0abfac-cfd0-42fb-b86c-90b7ce7f5554 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:09.384810 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-aa0abfac-cfd0-42fb-b86c-90b7ce7f5554 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1371 microversion: 2.1 time: 0.228740 Aug 05 10:29:09.399366 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 238/473] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:09 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:09.928500 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-91e303c3-107a-4f3e-b95e-f086c6610289 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Action: 'create', calling method: .version_select at 0x7f7327610280>, body: {"keypair": {"name": "tempest-TestShelveInstance-84234557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVkJhPqStvQxk65vpZpG/VauNoFBtT6354juBfvbiugGbPq95KdY0u5dQ55osV3rmMSp9xQ961qJ/aoay7Iu7D/sDl7kho/iO1QKFCuGF90DK8lv/wG4FnM237VSXQTCA=="}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:29:09.947049 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-91e303c3-107a-4f3e-b95e-f086c6610289 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Getting quotas for project 4183067b2b9c429d85238263419ec3f7. Resources: {'key_pairs'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:29:09.951379 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-91e303c3-107a-4f3e-b95e-f086c6610289 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Getting quotas for user a4b9bf1486c745f0bd204307b942809a and project 4183067b2b9c429d85238263419ec3f7. Resources: {'key_pairs'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:29:09.978334 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-91e303c3-107a-4f3e-b95e-f086c6610289 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.243793 Aug 05 10:29:09.987211 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 236/474] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 5 10:29:09 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:29:10.165266 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-07152b4e-0b98-4dba-be6e-8ab9bff4792b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:10.167136 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-07152b4e-0b98-4dba-be6e-8ab9bff4792b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 45eeb821-0eca-4aac-9bfa-7abf8340adbe] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:10.176244 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07152b4e-0b98-4dba-be6e-8ab9bff4792b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:10.177072 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07152b4e-0b98-4dba-be6e-8ab9bff4792b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:10.177775 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07152b4e-0b98-4dba-be6e-8ab9bff4792b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:10.179335 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07152b4e-0b98-4dba-be6e-8ab9bff4792b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:10.180568 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07152b4e-0b98-4dba-be6e-8ab9bff4792b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:10.181330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07152b4e-0b98-4dba-be6e-8ab9bff4792b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:10.362850 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-07152b4e-0b98-4dba-be6e-8ab9bff4792b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:10.372897 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-07152b4e-0b98-4dba-be6e-8ab9bff4792b tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe" status: 200 len: 1503 microversion: 2.1 time: 0.211614 Aug 05 10:29:10.374003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 239/475] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:10 2022] GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe => generated 1503 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:10.406687 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ba8a6017-8bbe-4460-b927-375fc4dafa11 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:10.407948 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-ba8a6017-8bbe-4460-b927-375fc4dafa11 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:10.415974 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ba8a6017-8bbe-4460-b927-375fc4dafa11 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:10.416645 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ba8a6017-8bbe-4460-b927-375fc4dafa11 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:10.417446 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ba8a6017-8bbe-4460-b927-375fc4dafa11 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:10.418615 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ba8a6017-8bbe-4460-b927-375fc4dafa11 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:10.419879 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ba8a6017-8bbe-4460-b927-375fc4dafa11 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:10.421395 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ba8a6017-8bbe-4460-b927-375fc4dafa11 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:10.624514 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ba8a6017-8bbe-4460-b927-375fc4dafa11 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:10.633604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ba8a6017-8bbe-4460-b927-375fc4dafa11 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1371 microversion: 2.1 time: 0.231421 Aug 05 10:29:10.634696 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 237/476] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:10 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:11.395645 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c05f0a84-6a83-470e-8710-5f4a10792011 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:11.396232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c05f0a84-6a83-470e-8710-5f4a10792011 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 45eeb821-0eca-4aac-9bfa-7abf8340adbe] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:11.403409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c05f0a84-6a83-470e-8710-5f4a10792011 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:11.403859 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c05f0a84-6a83-470e-8710-5f4a10792011 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:11.404278 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c05f0a84-6a83-470e-8710-5f4a10792011 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:11.404963 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c05f0a84-6a83-470e-8710-5f4a10792011 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:11.405426 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c05f0a84-6a83-470e-8710-5f4a10792011 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:11.405862 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c05f0a84-6a83-470e-8710-5f4a10792011 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:11.556289 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c05f0a84-6a83-470e-8710-5f4a10792011 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:11.566503 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c05f0a84-6a83-470e-8710-5f4a10792011 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe" status: 200 len: 1503 microversion: 2.1 time: 0.175034 Aug 05 10:29:11.567275 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 240/477] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:11 2022] GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:11.656120 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-2a6efb5f-6f0e-468c-ba54-48be1fb9e2fb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:11.659170 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-2a6efb5f-6f0e-468c-ba54-48be1fb9e2fb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:11.683750 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2a6efb5f-6f0e-468c-ba54-48be1fb9e2fb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:11.684246 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2a6efb5f-6f0e-468c-ba54-48be1fb9e2fb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:11.684966 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2a6efb5f-6f0e-468c-ba54-48be1fb9e2fb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:11.685777 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2a6efb5f-6f0e-468c-ba54-48be1fb9e2fb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:11.686228 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2a6efb5f-6f0e-468c-ba54-48be1fb9e2fb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:11.686757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2a6efb5f-6f0e-468c-ba54-48be1fb9e2fb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:11.899472 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2a6efb5f-6f0e-468c-ba54-48be1fb9e2fb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:11.910201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-2a6efb5f-6f0e-468c-ba54-48be1fb9e2fb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1371 microversion: 2.1 time: 0.258368 Aug 05 10:29:11.914784 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 238/478] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:11 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1371 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:12.592524 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9835f908-ad39-47c6-a63e-1782804645c4 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:12.595830 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9835f908-ad39-47c6-a63e-1782804645c4 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 45eeb821-0eca-4aac-9bfa-7abf8340adbe] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:12.598042 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:29:12.598879 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=14 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:29:12.606752 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9835f908-ad39-47c6-a63e-1782804645c4 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:12.607483 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9835f908-ad39-47c6-a63e-1782804645c4 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:12.607906 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9835f908-ad39-47c6-a63e-1782804645c4 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:12.608776 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9835f908-ad39-47c6-a63e-1782804645c4 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:12.609222 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9835f908-ad39-47c6-a63e-1782804645c4 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:12.609636 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9835f908-ad39-47c6-a63e-1782804645c4 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:12.934833 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-5a74e87b-604a-4754-ac30-4b5b24124f28 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:12.936227 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-5a74e87b-604a-4754-ac30-4b5b24124f28 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:12.943826 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5a74e87b-604a-4754-ac30-4b5b24124f28 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:12.944467 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5a74e87b-604a-4754-ac30-4b5b24124f28 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:12.945133 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5a74e87b-604a-4754-ac30-4b5b24124f28 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:12.946068 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5a74e87b-604a-4754-ac30-4b5b24124f28 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:12.946862 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5a74e87b-604a-4754-ac30-4b5b24124f28 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:12.947444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5a74e87b-604a-4754-ac30-4b5b24124f28 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:13.047653 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9835f908-ad39-47c6-a63e-1782804645c4 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:13.057710 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9835f908-ad39-47c6-a63e-1782804645c4 tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe" status: 200 len: 1503 microversion: 2.1 time: 0.469617 Aug 05 10:29:13.072441 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 241/479] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:12 2022] GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe => generated 1503 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:13.119520 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-940f00c6-6af5-49d3-843b-2c44007ff5f8 req-96038cb1-2a1c-4c91-9575-5f49bfd4bcaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45eeb821-0eca-4aac-9bfa-7abf8340adbe", "name": "network-vif-deleted", "tag": "527e35d3-4e12-43f4-bdcc-a360a0dc21a0"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:29:13.129958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-940f00c6-6af5-49d3-843b-2c44007ff5f8 req-96038cb1-2a1c-4c91-9575-5f49bfd4bcaa service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:13.130436 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-940f00c6-6af5-49d3-843b-2c44007ff5f8 req-96038cb1-2a1c-4c91-9575-5f49bfd4bcaa service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:13.131715 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-940f00c6-6af5-49d3-843b-2c44007ff5f8 req-96038cb1-2a1c-4c91-9575-5f49bfd4bcaa service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:13.145074 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-940f00c6-6af5-49d3-843b-2c44007ff5f8 req-96038cb1-2a1c-4c91-9575-5f49bfd4bcaa service nova] Creating event network-vif-deleted:527e35d3-4e12-43f4-bdcc-a360a0dc21a0 for instance 45eeb821-0eca-4aac-9bfa-7abf8340adbe on hv-cinder-81558 Aug 05 10:29:13.150646 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-940f00c6-6af5-49d3-843b-2c44007ff5f8 req-96038cb1-2a1c-4c91-9575-5f49bfd4bcaa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034921 Aug 05 10:29:13.151772 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 242/480] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:29:13.255723 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-5a74e87b-604a-4754-ac30-4b5b24124f28 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:13.264401 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-5a74e87b-604a-4754-ac30-4b5b24124f28 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1371 microversion: 2.1 time: 0.333474 Aug 05 10:29:13.265003 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 239/481] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:12 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1371 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:14.082753 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-744b3b74-e0ce-44fa-bff6-911d69b78b2a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:14.083299 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-744b3b74-e0ce-44fa-bff6-911d69b78b2a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 45eeb821-0eca-4aac-9bfa-7abf8340adbe] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:14.090216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-744b3b74-e0ce-44fa-bff6-911d69b78b2a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:14.090648 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-744b3b74-e0ce-44fa-bff6-911d69b78b2a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:14.091142 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-744b3b74-e0ce-44fa-bff6-911d69b78b2a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:14.091837 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-744b3b74-e0ce-44fa-bff6-911d69b78b2a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:14.092279 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-744b3b74-e0ce-44fa-bff6-911d69b78b2a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:14.092690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-744b3b74-e0ce-44fa-bff6-911d69b78b2a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:14.132262 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-744b3b74-e0ce-44fa-bff6-911d69b78b2a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:14.133482 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-744b3b74-e0ce-44fa-bff6-911d69b78b2a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:14.134118 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-744b3b74-e0ce-44fa-bff6-911d69b78b2a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:14.134755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-744b3b74-e0ce-44fa-bff6-911d69b78b2a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lazy-loading 'fault' on Instance uuid 45eeb821-0eca-4aac-9bfa-7abf8340adbe {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:29:14.196369 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-744b3b74-e0ce-44fa-bff6-911d69b78b2a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723cdbd378743378b1fccc2d15bc53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8139ee97548e89fcb7b38c5bd99fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:14.206512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-744b3b74-e0ce-44fa-bff6-911d69b78b2a tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe" status: 200 len: 1303 microversion: 2.1 time: 0.128663 Aug 05 10:29:14.207506 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 243/482] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:14 2022] GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe => generated 1303 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:14.287595 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-6c7cd4dc-1ace-4c40-8793-27f22c4b1ba5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:14.288202 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-6c7cd4dc-1ace-4c40-8793-27f22c4b1ba5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:14.295568 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6c7cd4dc-1ace-4c40-8793-27f22c4b1ba5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:14.296152 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6c7cd4dc-1ace-4c40-8793-27f22c4b1ba5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:14.296612 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6c7cd4dc-1ace-4c40-8793-27f22c4b1ba5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:14.297307 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6c7cd4dc-1ace-4c40-8793-27f22c4b1ba5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:14.297754 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6c7cd4dc-1ace-4c40-8793-27f22c4b1ba5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:14.298160 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6c7cd4dc-1ace-4c40-8793-27f22c4b1ba5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:14.335253 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-2f74225e-dcfc-4805-9102-80b0c23e8a88 req-0445f7c5-41fb-49df-905f-a6962b3fe07c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94bc927e-f379-4a93-a980-289f58af66f9", "name": "network-vif-plugged", "status": "completed", "tag": "76d42f2f-ee41-465d-bac5-77d316e82d9d"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:29:14.347141 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-2f74225e-dcfc-4805-9102-80b0c23e8a88 req-0445f7c5-41fb-49df-905f-a6962b3fe07c service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:14.347870 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-2f74225e-dcfc-4805-9102-80b0c23e8a88 req-0445f7c5-41fb-49df-905f-a6962b3fe07c service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:14.348394 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-2f74225e-dcfc-4805-9102-80b0c23e8a88 req-0445f7c5-41fb-49df-905f-a6962b3fe07c service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:14.362305 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-2f74225e-dcfc-4805-9102-80b0c23e8a88 req-0445f7c5-41fb-49df-905f-a6962b3fe07c service nova] Creating event network-vif-plugged:76d42f2f-ee41-465d-bac5-77d316e82d9d for instance 94bc927e-f379-4a93-a980-289f58af66f9 on hv-cinder-81558 Aug 05 10:29:14.366389 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-2f74225e-dcfc-4805-9102-80b0c23e8a88 req-0445f7c5-41fb-49df-905f-a6962b3fe07c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036819 Aug 05 10:29:14.367591 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 244/483] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:29:14.446496 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-6c7cd4dc-1ace-4c40-8793-27f22c4b1ba5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:14.454111 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-6c7cd4dc-1ace-4c40-8793-27f22c4b1ba5 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1371 microversion: 2.1 time: 0.171642 Aug 05 10:29:14.454680 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 240/484] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:14 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:15.229909 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3c38eff1-3718-48a7-b44d-e198dc0ab10e tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:15.230647 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3c38eff1-3718-48a7-b44d-e198dc0ab10e tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] [instance: 45eeb821-0eca-4aac-9bfa-7abf8340adbe] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:15.238432 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3c38eff1-3718-48a7-b44d-e198dc0ab10e tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:15.239146 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3c38eff1-3718-48a7-b44d-e198dc0ab10e tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:15.239609 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3c38eff1-3718-48a7-b44d-e198dc0ab10e tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:15.240315 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3c38eff1-3718-48a7-b44d-e198dc0ab10e tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:15.240765 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3c38eff1-3718-48a7-b44d-e198dc0ab10e tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:15.241182 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3c38eff1-3718-48a7-b44d-e198dc0ab10e tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:15.256457 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-3c38eff1-3718-48a7-b44d-e198dc0ab10e tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] HTTP exception thrown: Instance 45eeb821-0eca-4aac-9bfa-7abf8340adbe could not be found. Aug 05 10:29:15.260192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3c38eff1-3718-48a7-b44d-e198dc0ab10e tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Request method failure captured: Aug 05 10:29:15.260192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe HTTP/1.1 Aug 05 10:29:15.260192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:29:15.260192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:29:15.260192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:29:15.260192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:29:15.260192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:29:15.260192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:29:15.260192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:29:15.260192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:29:15.260192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PCw7BpVC0e9sesMLPhGZN06ekesH-ZQijrgnA4zatkfTKmAIx1k2o4MseFD0eqioCNHUSlJnsM7SE8SONYwoRjsx_5CHd6spvPPaYzoIiQj33ysITxnSxYjBCdCaJUEAsseFs5whcpvX1xsvTZFBit0GiQKENTVsj_K-dyl07HcDY4 Aug 05 10:29:15.260192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:29:15.260192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:29:15.260192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:29:15.260192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:29:15.260192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:29:15.260192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:29:15.260192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: a4a8139ee97548e89fcb7b38c5bd99fe Aug 05 10:29:15.260192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesActionsTest-52410631 Aug 05 10:29:15.260192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:29:15.260192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:29:15.261512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a4a8139ee97548e89fcb7b38c5bd99fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a4a8139ee97548e89fcb7b38c5bd99fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4a8139ee97548e89fcb7b38c5bd99fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4a8139ee97548e89fcb7b38c5bd99fe"}]}] Aug 05 10:29:15.261512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesActionsTest-52410631 Aug 05 10:29:15.261512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: a4a8139ee97548e89fcb7b38c5bd99fe Aug 05 10:29:15.261512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesActionsTest-52410631 Aug 05 10:29:15.261512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesActionsTest-52410631-project Aug 05 10:29:15.261512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:29:15.261512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:29:15.261512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: 7723cdbd378743378b1fccc2d15bc53b Aug 05 10:29:15.261512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesActionsTest-52410631-project Aug 05 10:29:15.261512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:29:15.261512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Instance 45eeb821-0eca-4aac-9bfa-7abf8340adbe could not be found. Aug 05 10:29:15.261512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': '45eeb821-0eca-4aac-9bfa-7abf8340adbe'} Aug 05 10:29:15.262216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:29:15.262216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:29:15.262216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:29:15.262216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:29:15.262216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:29:15.262216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:29:15.262216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:29:15.262216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:29:15.262216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:29:15.262216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:29:15.262216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45eeb821-0eca-4aac-9bfa-7abf8340adbe could not be found. Aug 05 10:29:15.262216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:29:15.262216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:29:15.262216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:29:15.262216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:29:15.262216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:29:15.262216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:29:15.262216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:29:15.262216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:29:15.262216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:29:15.264083 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:29:15.264083 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:29:15.264083 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:29:15.264083 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:29:15.264083 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:29:15.264083 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:29:15.264083 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:29:15.264083 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45eeb821-0eca-4aac-9bfa-7abf8340adbe could not be found. Aug 05 10:29:15.264083 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:29:15.264083 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:29:15.264083 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:29:15.264083 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:29:15.264083 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:29:15.264083 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:29:15.264083 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:29:15.264083 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:29:15.264083 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45eeb821-0eca-4aac-9bfa-7abf8340adbe could not be found. Aug 05 10:29:15.264083 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:29:15.265630 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3c38eff1-3718-48a7-b44d-e198dc0ab10e tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] Returning 404 to user: Instance 45eeb821-0eca-4aac-9bfa-7abf8340adbe could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:29:15.265630 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3c38eff1-3718-48a7-b44d-e198dc0ab10e tempest-VolumesActionsTest-52410631 tempest-VolumesActionsTest-52410631-project] 10.222.0.40 "GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe" status: 404 len: 111 microversion: 2.1 time: 0.036499 Aug 05 10:29:15.265630 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 245/485] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:15 2022] GET /compute/v2.1/servers/45eeb821-0eca-4aac-9bfa-7abf8340adbe => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:29:15.478081 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-4ea00ddb-0106-4829-81a1-a532608eca0a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:15.478697 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-4ea00ddb-0106-4829-81a1-a532608eca0a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:15.485820 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4ea00ddb-0106-4829-81a1-a532608eca0a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:15.486415 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4ea00ddb-0106-4829-81a1-a532608eca0a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:15.486745 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4ea00ddb-0106-4829-81a1-a532608eca0a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:15.487497 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4ea00ddb-0106-4829-81a1-a532608eca0a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:15.487956 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4ea00ddb-0106-4829-81a1-a532608eca0a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:15.488541 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4ea00ddb-0106-4829-81a1-a532608eca0a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:15.632597 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-4ea00ddb-0106-4829-81a1-a532608eca0a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:15.643629 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-4ea00ddb-0106-4829-81a1-a532608eca0a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1371 microversion: 2.1 time: 0.169479 Aug 05 10:29:15.644417 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 241/486] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:15 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:16.665333 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-93788c8a-d8da-4c6e-a8c2-d7a640bae551 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:16.665879 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-93788c8a-d8da-4c6e-a8c2-d7a640bae551 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:16.672854 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-93788c8a-d8da-4c6e-a8c2-d7a640bae551 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:16.673334 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-93788c8a-d8da-4c6e-a8c2-d7a640bae551 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:16.673773 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-93788c8a-d8da-4c6e-a8c2-d7a640bae551 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:16.674469 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-93788c8a-d8da-4c6e-a8c2-d7a640bae551 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:16.674940 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-93788c8a-d8da-4c6e-a8c2-d7a640bae551 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:16.675369 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-93788c8a-d8da-4c6e-a8c2-d7a640bae551 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:16.811417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-93788c8a-d8da-4c6e-a8c2-d7a640bae551 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:16.819340 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-93788c8a-d8da-4c6e-a8c2-d7a640bae551 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1371 microversion: 2.1 time: 0.158069 Aug 05 10:29:16.819911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 246/487] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:16 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:17.844543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-3ec45e35-1fc0-4469-94c7-fe5aefe25635 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:17.845546 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-3ec45e35-1fc0-4469-94c7-fe5aefe25635 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:17.854107 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3ec45e35-1fc0-4469-94c7-fe5aefe25635 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:17.854574 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3ec45e35-1fc0-4469-94c7-fe5aefe25635 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:17.855095 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3ec45e35-1fc0-4469-94c7-fe5aefe25635 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:17.855789 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3ec45e35-1fc0-4469-94c7-fe5aefe25635 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:17.856322 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3ec45e35-1fc0-4469-94c7-fe5aefe25635 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:17.856771 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3ec45e35-1fc0-4469-94c7-fe5aefe25635 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:18.001118 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-3ec45e35-1fc0-4469-94c7-fe5aefe25635 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:18.008863 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-3ec45e35-1fc0-4469-94c7-fe5aefe25635 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1371 microversion: 2.1 time: 0.170971 Aug 05 10:29:18.009420 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 242/488] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:17 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:19.029268 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0be8efa8-5b92-4b42-89cd-dcf72d103c4e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:19.029978 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0be8efa8-5b92-4b42-89cd-dcf72d103c4e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:19.037155 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0be8efa8-5b92-4b42-89cd-dcf72d103c4e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:19.037632 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0be8efa8-5b92-4b42-89cd-dcf72d103c4e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:19.038057 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0be8efa8-5b92-4b42-89cd-dcf72d103c4e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:19.038740 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0be8efa8-5b92-4b42-89cd-dcf72d103c4e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:19.039214 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0be8efa8-5b92-4b42-89cd-dcf72d103c4e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:19.039618 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0be8efa8-5b92-4b42-89cd-dcf72d103c4e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:19.174457 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0be8efa8-5b92-4b42-89cd-dcf72d103c4e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:19.182287 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0be8efa8-5b92-4b42-89cd-dcf72d103c4e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1371 microversion: 2.1 time: 0.157005 Aug 05 10:29:19.182847 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 247/489] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:19 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:20.204124 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-6927ef7d-6c9a-421a-bec0-1b5e98df9321 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:20.204799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-6927ef7d-6c9a-421a-bec0-1b5e98df9321 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:20.207401 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=4 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:29:20.213106 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6927ef7d-6c9a-421a-bec0-1b5e98df9321 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:20.213594 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6927ef7d-6c9a-421a-bec0-1b5e98df9321 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:20.214027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6927ef7d-6c9a-421a-bec0-1b5e98df9321 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:20.214738 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6927ef7d-6c9a-421a-bec0-1b5e98df9321 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:20.215216 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6927ef7d-6c9a-421a-bec0-1b5e98df9321 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:20.215643 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6927ef7d-6c9a-421a-bec0-1b5e98df9321 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:20.354830 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-6927ef7d-6c9a-421a-bec0-1b5e98df9321 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:20.362484 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-6927ef7d-6c9a-421a-bec0-1b5e98df9321 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1371 microversion: 2.1 time: 0.163155 Aug 05 10:29:20.363109 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 243/490] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:20 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:21.387608 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7b604cd1-beaa-4846-9e85-d2f5bed4b07e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:21.388550 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7b604cd1-beaa-4846-9e85-d2f5bed4b07e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:21.398516 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b604cd1-beaa-4846-9e85-d2f5bed4b07e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:21.399025 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b604cd1-beaa-4846-9e85-d2f5bed4b07e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:21.399455 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b604cd1-beaa-4846-9e85-d2f5bed4b07e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:21.400143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b604cd1-beaa-4846-9e85-d2f5bed4b07e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:21.400591 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b604cd1-beaa-4846-9e85-d2f5bed4b07e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:21.401011 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b604cd1-beaa-4846-9e85-d2f5bed4b07e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:21.548461 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7b604cd1-beaa-4846-9e85-d2f5bed4b07e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:21.556367 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7b604cd1-beaa-4846-9e85-d2f5bed4b07e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1371 microversion: 2.1 time: 0.175326 Aug 05 10:29:21.556899 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 248/491] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:21 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:22.583080 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-3a883d31-87ad-4b76-8d56-316aa7af9f68 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:22.583853 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-3a883d31-87ad-4b76-8d56-316aa7af9f68 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:22.591423 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3a883d31-87ad-4b76-8d56-316aa7af9f68 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:22.591913 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3a883d31-87ad-4b76-8d56-316aa7af9f68 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:22.592319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3a883d31-87ad-4b76-8d56-316aa7af9f68 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:22.593046 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3a883d31-87ad-4b76-8d56-316aa7af9f68 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:22.593500 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3a883d31-87ad-4b76-8d56-316aa7af9f68 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:22.593927 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3a883d31-87ad-4b76-8d56-316aa7af9f68 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:22.597912 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=100 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:29:22.736111 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-3a883d31-87ad-4b76-8d56-316aa7af9f68 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:22.744164 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-3a883d31-87ad-4b76-8d56-316aa7af9f68 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1371 microversion: 2.1 time: 0.166391 Aug 05 10:29:22.744731 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 244/492] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:22 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:23.769782 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fd5833d9-449b-45e5-9629-92d60d2551bd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:23.770637 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fd5833d9-449b-45e5-9629-92d60d2551bd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:23.774684 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:29:23.784772 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd5833d9-449b-45e5-9629-92d60d2551bd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:23.785562 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd5833d9-449b-45e5-9629-92d60d2551bd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:23.786260 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd5833d9-449b-45e5-9629-92d60d2551bd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:23.787514 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd5833d9-449b-45e5-9629-92d60d2551bd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:23.788561 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd5833d9-449b-45e5-9629-92d60d2551bd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:23.789287 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd5833d9-449b-45e5-9629-92d60d2551bd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:23.945898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fd5833d9-449b-45e5-9629-92d60d2551bd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:23.953835 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fd5833d9-449b-45e5-9629-92d60d2551bd tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1371 microversion: 2.1 time: 0.190677 Aug 05 10:29:23.954416 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 249/493] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:23 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:24.975287 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-6b22fcdd-578e-4793-b810-934d98d26649 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:24.976033 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-6b22fcdd-578e-4793-b810-934d98d26649 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:24.983730 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6b22fcdd-578e-4793-b810-934d98d26649 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:24.984229 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6b22fcdd-578e-4793-b810-934d98d26649 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:24.984665 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6b22fcdd-578e-4793-b810-934d98d26649 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:24.985453 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6b22fcdd-578e-4793-b810-934d98d26649 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:24.985900 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6b22fcdd-578e-4793-b810-934d98d26649 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:24.986330 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6b22fcdd-578e-4793-b810-934d98d26649 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:25.130457 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-6b22fcdd-578e-4793-b810-934d98d26649 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:25.138872 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-6b22fcdd-578e-4793-b810-934d98d26649 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1564 microversion: 2.1 time: 0.167820 Aug 05 10:29:25.139473 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 245/494] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:24 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:25.162929 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-13d38337-540c-4588-8cb8-8a7b85107280 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:25.163381 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-13d38337-540c-4588-8cb8-8a7b85107280 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:25.170752 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-13d38337-540c-4588-8cb8-8a7b85107280 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:25.171361 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-13d38337-540c-4588-8cb8-8a7b85107280 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:25.171792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-13d38337-540c-4588-8cb8-8a7b85107280 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:25.172490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-13d38337-540c-4588-8cb8-8a7b85107280 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:25.172956 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-13d38337-540c-4588-8cb8-8a7b85107280 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:25.173373 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-13d38337-540c-4588-8cb8-8a7b85107280 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:25.267978 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-13d38337-540c-4588-8cb8-8a7b85107280 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108885 Aug 05 10:29:25.268807 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 250/495] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 5 10:29:25 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:29:26.370018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-bfcd9e5f-802d-4eff-be23-4daa79fd8336 req-f69a0e0e-a268-40fa-bf43-539bea98be3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94bc927e-f379-4a93-a980-289f58af66f9", "tag": "76d42f2f-ee41-465d-bac5-77d316e82d9d"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:29:26.382009 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-bfcd9e5f-802d-4eff-be23-4daa79fd8336 req-f69a0e0e-a268-40fa-bf43-539bea98be3b service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:26.382499 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-bfcd9e5f-802d-4eff-be23-4daa79fd8336 req-f69a0e0e-a268-40fa-bf43-539bea98be3b service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:26.382963 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-bfcd9e5f-802d-4eff-be23-4daa79fd8336 req-f69a0e0e-a268-40fa-bf43-539bea98be3b service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:26.399096 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-bfcd9e5f-802d-4eff-be23-4daa79fd8336 req-f69a0e0e-a268-40fa-bf43-539bea98be3b service nova] Creating event network-changed:76d42f2f-ee41-465d-bac5-77d316e82d9d for instance 94bc927e-f379-4a93-a980-289f58af66f9 on hv-cinder-81558 Aug 05 10:29:26.420166 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-bfcd9e5f-802d-4eff-be23-4daa79fd8336 req-f69a0e0e-a268-40fa-bf43-539bea98be3b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054848 Aug 05 10:29:26.427170 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 246/496] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:29:40.118934 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:29:40.120665 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:29:40.126472 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f8a80327-d22d-4634-a26c-e01da4afe67a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:40.127308 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f8a80327-d22d-4634-a26c-e01da4afe67a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:40.135062 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f8a80327-d22d-4634-a26c-e01da4afe67a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:40.135544 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f8a80327-d22d-4634-a26c-e01da4afe67a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:40.136182 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f8a80327-d22d-4634-a26c-e01da4afe67a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:40.137101 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f8a80327-d22d-4634-a26c-e01da4afe67a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:40.137400 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f8a80327-d22d-4634-a26c-e01da4afe67a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:40.137792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f8a80327-d22d-4634-a26c-e01da4afe67a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:40.175366 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f8a80327-d22d-4634-a26c-e01da4afe67a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a/ips" status: 200 len: 144 microversion: 2.1 time: 0.057933 Aug 05 10:29:40.176362 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 251/497] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 5 10:29:40 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a/ips => generated 144 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:29:40.324946 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-7ff1398b-db9c-4b50-aa0d-910da58be14d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1461018990", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-84234557", "security_groups": [{"name": "tempest-secgroup-smoke-2048897887"}], "networks": [{"uuid": "82daf554-41ff-40a9-845e-86d9400e234c"}], "block_device_mapping_v2": [{"uuid": "30b546bc-a6d9-488f-ad92-6eaf8ac0133c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:29:40.343280 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:29:40.345078 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=12 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:29:40.484721 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.network.neutron [None req-7ff1398b-db9c-4b50-aa0d-910da58be14d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] validate_networks() for [('82daf554-41ff-40a9-845e-86d9400e234c', None, None, None, None, None)] {{(pid=117831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 10:29:41.260617 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-7ff1398b-db9c-4b50-aa0d-910da58be14d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Flavor limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 10:29:41.261176 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-7ff1398b-db9c-4b50-aa0d-910da58be14d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Image limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 10:29:41.261730 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-7ff1398b-db9c-4b50-aa0d-910da58be14d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Flavor pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 10:29:41.262134 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-7ff1398b-db9c-4b50-aa0d-910da58be14d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Image pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 10:29:41.262535 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-7ff1398b-db9c-4b50-aa0d-910da58be14d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 10:29:41.272502 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7ff1398b-db9c-4b50-aa0d-910da58be14d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:41.272976 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7ff1398b-db9c-4b50-aa0d-910da58be14d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:41.273400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7ff1398b-db9c-4b50-aa0d-910da58be14d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:41.274104 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7ff1398b-db9c-4b50-aa0d-910da58be14d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:41.274545 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7ff1398b-db9c-4b50-aa0d-910da58be14d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:41.274979 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7ff1398b-db9c-4b50-aa0d-910da58be14d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:41.293109 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-7ff1398b-db9c-4b50-aa0d-910da58be14d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Getting quotas for project 4183067b2b9c429d85238263419ec3f7. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:29:41.297132 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-7ff1398b-db9c-4b50-aa0d-910da58be14d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Getting quotas for user a4b9bf1486c745f0bd204307b942809a and project 4183067b2b9c429d85238263419ec3f7. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:29:41.373687 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-7ff1398b-db9c-4b50-aa0d-910da58be14d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Going to run 1 instances... {{(pid=117831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 10:29:41.376182 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-7ff1398b-db9c-4b50-aa0d-910da58be14d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='30b546bc-a6d9-488f-ad92-6eaf8ac0133c',volume_size=None,volume_type=None)] {{(pid=117831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 10:29:41.536108 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-7ff1398b-db9c-4b50-aa0d-910da58be14d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.216163 Aug 05 10:29:41.536978 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 247/498] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 10:29:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 10:29:41.548029 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-07afdeec-a2ce-43ce-acd1-3e8e750f67bc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:41.549292 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-07afdeec-a2ce-43ce-acd1-3e8e750f67bc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:41.605130 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-07afdeec-a2ce-43ce-acd1-3e8e750f67bc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:41.613057 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-07afdeec-a2ce-43ce-acd1-3e8e750f67bc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1087 microversion: 2.1 time: 0.068845 Aug 05 10:29:41.613625 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 252/499] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:41 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1087 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:42.634528 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c92d89e5-67f9-4782-a08a-199b674cdcdf tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:42.635169 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c92d89e5-67f9-4782-a08a-199b674cdcdf tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:42.642006 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c92d89e5-67f9-4782-a08a-199b674cdcdf tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:42.642485 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c92d89e5-67f9-4782-a08a-199b674cdcdf tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:42.642921 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c92d89e5-67f9-4782-a08a-199b674cdcdf tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:42.643631 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c92d89e5-67f9-4782-a08a-199b674cdcdf tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:42.644073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c92d89e5-67f9-4782-a08a-199b674cdcdf tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:42.644588 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c92d89e5-67f9-4782-a08a-199b674cdcdf tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:42.708072 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c92d89e5-67f9-4782-a08a-199b674cdcdf tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:42.716477 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c92d89e5-67f9-4782-a08a-199b674cdcdf tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1185 microversion: 2.1 time: 0.086748 Aug 05 10:29:42.717044 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 248/500] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:42 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:29:43.737991 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-acc2a43d-2844-4803-bda0-f402ece7aaf8 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:43.738602 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-acc2a43d-2844-4803-bda0-f402ece7aaf8 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:43.747163 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-acc2a43d-2844-4803-bda0-f402ece7aaf8 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:43.747649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-acc2a43d-2844-4803-bda0-f402ece7aaf8 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:43.748077 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-acc2a43d-2844-4803-bda0-f402ece7aaf8 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:43.748777 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-acc2a43d-2844-4803-bda0-f402ece7aaf8 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:43.749231 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-acc2a43d-2844-4803-bda0-f402ece7aaf8 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:43.749649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-acc2a43d-2844-4803-bda0-f402ece7aaf8 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:43.846314 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c2ee5dfc-cb15-4586-8545-cd1f110d4d36 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40b8050a-869e-401c-bec5-e2ae81488822"}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:29:43.849015 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c2ee5dfc-cb15-4586-8545-cd1f110d4d36 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:43.856876 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c2ee5dfc-cb15-4586-8545-cd1f110d4d36 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:43.857873 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c2ee5dfc-cb15-4586-8545-cd1f110d4d36 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:43.858581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c2ee5dfc-cb15-4586-8545-cd1f110d4d36 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:43.860374 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c2ee5dfc-cb15-4586-8545-cd1f110d4d36 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:43.862081 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c2ee5dfc-cb15-4586-8545-cd1f110d4d36 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:43.862722 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c2ee5dfc-cb15-4586-8545-cd1f110d4d36 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:43.903627 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-acc2a43d-2844-4803-bda0-f402ece7aaf8 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:43.924766 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-acc2a43d-2844-4803-bda0-f402ece7aaf8 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1271 microversion: 2.1 time: 0.187579 Aug 05 10:29:43.925701 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 253/501] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:43 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1271 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:44.296555 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c2ee5dfc-cb15-4586-8545-cd1f110d4d36 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "POST /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.453942 Aug 05 10:29:44.297544 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 249/502] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 10:29:43 2022] POST /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a/os-volume_attachments => generated 194 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:29:44.786839 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-b0eda9ae-e5ce-4b15-b2a7-1c9e3fb59c84 req-3534dc37-5c09-4ade-a6b9-afc1bbd1c7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b987816b-37ef-46a2-b94e-5c3954662b58", "tag": "b38f7bd7-6d1e-4b76-8780-abac7a1bd11a"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:29:44.797423 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-b0eda9ae-e5ce-4b15-b2a7-1c9e3fb59c84 req-3534dc37-5c09-4ade-a6b9-afc1bbd1c7a8 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:44.798060 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-b0eda9ae-e5ce-4b15-b2a7-1c9e3fb59c84 req-3534dc37-5c09-4ade-a6b9-afc1bbd1c7a8 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:44.798854 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-b0eda9ae-e5ce-4b15-b2a7-1c9e3fb59c84 req-3534dc37-5c09-4ade-a6b9-afc1bbd1c7a8 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:44.810702 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-b0eda9ae-e5ce-4b15-b2a7-1c9e3fb59c84 req-3534dc37-5c09-4ade-a6b9-afc1bbd1c7a8 service nova] Creating event network-changed:b38f7bd7-6d1e-4b76-8780-abac7a1bd11a for instance b987816b-37ef-46a2-b94e-5c3954662b58 on hv-cinder-81558 Aug 05 10:29:44.815855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-b0eda9ae-e5ce-4b15-b2a7-1c9e3fb59c84 req-3534dc37-5c09-4ade-a6b9-afc1bbd1c7a8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033579 Aug 05 10:29:44.816446 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 254/503] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:29:44.954925 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-870c572c-9e45-4227-b6fa-de5f2546db19 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:44.955649 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-870c572c-9e45-4227-b6fa-de5f2546db19 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:44.968446 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-870c572c-9e45-4227-b6fa-de5f2546db19 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:44.969408 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-870c572c-9e45-4227-b6fa-de5f2546db19 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:44.970010 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-870c572c-9e45-4227-b6fa-de5f2546db19 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:44.970859 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-870c572c-9e45-4227-b6fa-de5f2546db19 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:44.971600 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-870c572c-9e45-4227-b6fa-de5f2546db19 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:44.972173 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-870c572c-9e45-4227-b6fa-de5f2546db19 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:45.218017 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-870c572c-9e45-4227-b6fa-de5f2546db19 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:45.226238 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-870c572c-9e45-4227-b6fa-de5f2546db19 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1259 microversion: 2.1 time: 0.278920 Aug 05 10:29:45.226792 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 250/504] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:44 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1259 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:46.248706 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b89a6d82-a45c-47e4-a92e-37670d9cb64c tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:46.249450 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b89a6d82-a45c-47e4-a92e-37670d9cb64c tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:46.270995 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b89a6d82-a45c-47e4-a92e-37670d9cb64c tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:46.271607 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b89a6d82-a45c-47e4-a92e-37670d9cb64c tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:46.272132 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b89a6d82-a45c-47e4-a92e-37670d9cb64c tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:46.272944 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b89a6d82-a45c-47e4-a92e-37670d9cb64c tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:46.273539 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b89a6d82-a45c-47e4-a92e-37670d9cb64c tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:46.274135 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b89a6d82-a45c-47e4-a92e-37670d9cb64c tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:46.411776 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b89a6d82-a45c-47e4-a92e-37670d9cb64c tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:46.419991 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b89a6d82-a45c-47e4-a92e-37670d9cb64c tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1259 microversion: 2.1 time: 0.175758 Aug 05 10:29:46.420546 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 255/505] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:46 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:47.441808 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-807abec9-4984-4bf1-8185-8831c9b60ce5 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:47.442413 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-807abec9-4984-4bf1-8185-8831c9b60ce5 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:47.451036 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-807abec9-4984-4bf1-8185-8831c9b60ce5 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:47.451493 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-807abec9-4984-4bf1-8185-8831c9b60ce5 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:47.451952 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-807abec9-4984-4bf1-8185-8831c9b60ce5 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:47.452954 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-807abec9-4984-4bf1-8185-8831c9b60ce5 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:47.453406 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-807abec9-4984-4bf1-8185-8831c9b60ce5 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:47.453932 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-807abec9-4984-4bf1-8185-8831c9b60ce5 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:47.468539 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-455af2b1-08fe-45d1-bf43-b10d8ae2f706 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:47.469124 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-455af2b1-08fe-45d1-bf43-b10d8ae2f706 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:47.475898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-455af2b1-08fe-45d1-bf43-b10d8ae2f706 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:47.476441 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-455af2b1-08fe-45d1-bf43-b10d8ae2f706 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:47.476878 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-455af2b1-08fe-45d1-bf43-b10d8ae2f706 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:47.477573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-455af2b1-08fe-45d1-bf43-b10d8ae2f706 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:47.478023 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-455af2b1-08fe-45d1-bf43-b10d8ae2f706 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:47.478437 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-455af2b1-08fe-45d1-bf43-b10d8ae2f706 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:47.504338 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-455af2b1-08fe-45d1-bf43-b10d8ae2f706 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79/ips" status: 200 len: 151 microversion: 2.1 time: 0.040210 Aug 05 10:29:47.505243 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 256/506] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 5 10:29:47 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:29:47.592579 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-807abec9-4984-4bf1-8185-8831c9b60ce5 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:47.600372 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-807abec9-4984-4bf1-8185-8831c9b60ce5 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1259 microversion: 2.1 time: 0.163134 Aug 05 10:29:47.613380 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 251/507] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:47 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:48.623377 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5871588c-a9bf-439c-821f-33bafe358b58 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:48.624090 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5871588c-a9bf-439c-821f-33bafe358b58 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:48.631065 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5871588c-a9bf-439c-821f-33bafe358b58 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:48.631534 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5871588c-a9bf-439c-821f-33bafe358b58 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:48.631966 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5871588c-a9bf-439c-821f-33bafe358b58 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:48.632648 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5871588c-a9bf-439c-821f-33bafe358b58 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:48.633092 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5871588c-a9bf-439c-821f-33bafe358b58 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:48.633503 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5871588c-a9bf-439c-821f-33bafe358b58 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:48.774187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5871588c-a9bf-439c-821f-33bafe358b58 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:48.785714 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5871588c-a9bf-439c-821f-33bafe358b58 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1259 microversion: 2.1 time: 0.167712 Aug 05 10:29:48.786469 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 257/508] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:48 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:48.894111 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b584db4c-cd5b-47e2-80c8-e9203da620b0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "843f4994-a0d7-44a6-b614-8977f3400e5e"}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:29:48.896523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b584db4c-cd5b-47e2-80c8-e9203da620b0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:48.903116 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b584db4c-cd5b-47e2-80c8-e9203da620b0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:48.903611 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b584db4c-cd5b-47e2-80c8-e9203da620b0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:48.904046 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b584db4c-cd5b-47e2-80c8-e9203da620b0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:48.904740 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b584db4c-cd5b-47e2-80c8-e9203da620b0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:48.905238 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b584db4c-cd5b-47e2-80c8-e9203da620b0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:48.905663 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b584db4c-cd5b-47e2-80c8-e9203da620b0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:49.224238 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b584db4c-cd5b-47e2-80c8-e9203da620b0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "POST /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334016 Aug 05 10:29:49.224876 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 252/509] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 10:29:48 2022] POST /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:29:49.813626 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0a79a334-4ee0-4f4e-94d3-95f95ed17f1d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:49.814335 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0a79a334-4ee0-4f4e-94d3-95f95ed17f1d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:49.822801 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a79a334-4ee0-4f4e-94d3-95f95ed17f1d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:49.823449 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a79a334-4ee0-4f4e-94d3-95f95ed17f1d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:49.824000 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a79a334-4ee0-4f4e-94d3-95f95ed17f1d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:49.824867 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a79a334-4ee0-4f4e-94d3-95f95ed17f1d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:49.825437 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a79a334-4ee0-4f4e-94d3-95f95ed17f1d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:49.825974 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a79a334-4ee0-4f4e-94d3-95f95ed17f1d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:49.973907 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0a79a334-4ee0-4f4e-94d3-95f95ed17f1d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:49.982050 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0a79a334-4ee0-4f4e-94d3-95f95ed17f1d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1259 microversion: 2.1 time: 0.174784 Aug 05 10:29:49.982622 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 258/510] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:49 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:50.649976 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f99850d3-ef12-46e1-bda4-6f4f4a87d125 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:50.650873 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f99850d3-ef12-46e1-bda4-6f4f4a87d125 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:50.660275 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f99850d3-ef12-46e1-bda4-6f4f4a87d125 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:50.660751 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f99850d3-ef12-46e1-bda4-6f4f4a87d125 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:50.661175 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f99850d3-ef12-46e1-bda4-6f4f4a87d125 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:50.661852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f99850d3-ef12-46e1-bda4-6f4f4a87d125 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:50.662311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f99850d3-ef12-46e1-bda4-6f4f4a87d125 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:50.662726 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f99850d3-ef12-46e1-bda4-6f4f4a87d125 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:50.686933 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f99850d3-ef12-46e1-bda4-6f4f4a87d125 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b/ips" status: 200 len: 152 microversion: 2.20 time: 0.044963 Aug 05 10:29:50.687619 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 253/511] 10.222.0.40 () {60 vars in 1289 bytes} [Fri Aug 5 10:29:50 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b/ips => generated 152 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 10:29:51.007367 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1dcdef64-02a1-4e93-aad7-8ff4f99c3c21 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:51.007367 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1dcdef64-02a1-4e93-aad7-8ff4f99c3c21 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:51.013419 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1dcdef64-02a1-4e93-aad7-8ff4f99c3c21 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:51.014131 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1dcdef64-02a1-4e93-aad7-8ff4f99c3c21 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:51.014855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1dcdef64-02a1-4e93-aad7-8ff4f99c3c21 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:51.016774 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1dcdef64-02a1-4e93-aad7-8ff4f99c3c21 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:51.017462 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1dcdef64-02a1-4e93-aad7-8ff4f99c3c21 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:51.018120 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1dcdef64-02a1-4e93-aad7-8ff4f99c3c21 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:51.175522 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1dcdef64-02a1-4e93-aad7-8ff4f99c3c21 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:51.184134 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1dcdef64-02a1-4e93-aad7-8ff4f99c3c21 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1259 microversion: 2.1 time: 0.184476 Aug 05 10:29:51.184692 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 259/512] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:50 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:29:52.214950 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-74517438-a06d-4c14-aff1-62c928ece767 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:52.215587 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-74517438-a06d-4c14-aff1-62c928ece767 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:52.217991 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=2 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:29:52.218672 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=6 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:29:52.224785 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-74517438-a06d-4c14-aff1-62c928ece767 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:52.225260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-74517438-a06d-4c14-aff1-62c928ece767 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:52.225698 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-74517438-a06d-4c14-aff1-62c928ece767 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:52.226380 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-74517438-a06d-4c14-aff1-62c928ece767 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:52.226827 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-74517438-a06d-4c14-aff1-62c928ece767 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:52.227259 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-74517438-a06d-4c14-aff1-62c928ece767 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:52.366329 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-74517438-a06d-4c14-aff1-62c928ece767 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:52.374312 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-74517438-a06d-4c14-aff1-62c928ece767 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1259 microversion: 2.1 time: 0.163350 Aug 05 10:29:52.374878 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 254/513] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:52 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:52.949652 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c8294d59-f3c3-43e5-9782-34e51decdb27 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:29:52.951724 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:29:52.958433 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c8294d59-f3c3-43e5-9782-34e51decdb27 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:52.958952 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c8294d59-f3c3-43e5-9782-34e51decdb27 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:52.959385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c8294d59-f3c3-43e5-9782-34e51decdb27 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:53.022494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c8294d59-f3c3-43e5-9782-34e51decdb27 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Going to try to stop instance {{(pid=117832) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 05 10:29:53.071031 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c8294d59-f3c3-43e5-9782-34e51decdb27 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "POST /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a/action" status: 202 len: 0 microversion: 2.1 time: 0.124936 Aug 05 10:29:53.071578 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 260/514] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 10:29:52 2022] POST /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:29:53.081853 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-774a8b16-fdf5-425c-9025-97389b10da43 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:53.082450 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-774a8b16-fdf5-425c-9025-97389b10da43 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:53.089221 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-774a8b16-fdf5-425c-9025-97389b10da43 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:53.089701 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-774a8b16-fdf5-425c-9025-97389b10da43 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:53.090133 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-774a8b16-fdf5-425c-9025-97389b10da43 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:53.090812 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-774a8b16-fdf5-425c-9025-97389b10da43 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:53.091293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-774a8b16-fdf5-425c-9025-97389b10da43 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:53.091711 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-774a8b16-fdf5-425c-9025-97389b10da43 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:53.236666 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-774a8b16-fdf5-425c-9025-97389b10da43 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:53.245306 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-774a8b16-fdf5-425c-9025-97389b10da43 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1721 microversion: 2.1 time: 0.168886 Aug 05 10:29:53.245869 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 255/515] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:53 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:53.279566 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c46940ad-1c25-442f-a457-9957f939194c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:29:53.280185 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c46940ad-1c25-442f-a457-9957f939194c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:53.287295 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c46940ad-1c25-442f-a457-9957f939194c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:53.287778 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c46940ad-1c25-442f-a457-9957f939194c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:53.288214 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c46940ad-1c25-442f-a457-9957f939194c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:53.288911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c46940ad-1c25-442f-a457-9957f939194c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:53.289366 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c46940ad-1c25-442f-a457-9957f939194c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:53.289787 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c46940ad-1c25-442f-a457-9957f939194c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:53.313926 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-c46940ad-1c25-442f-a457-9957f939194c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lazy-loading 'flavor' on Instance uuid af7c11c7-dddb-481d-9d57-af021c48e71b {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:29:53.395953 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-52e6bdeb-74e9-4d24-8b5c-1a17ea8662a7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:53.399555 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-52e6bdeb-74e9-4d24-8b5c-1a17ea8662a7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:53.406386 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-52e6bdeb-74e9-4d24-8b5c-1a17ea8662a7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:53.407245 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-52e6bdeb-74e9-4d24-8b5c-1a17ea8662a7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:53.407670 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-52e6bdeb-74e9-4d24-8b5c-1a17ea8662a7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:53.408364 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-52e6bdeb-74e9-4d24-8b5c-1a17ea8662a7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:53.408915 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-52e6bdeb-74e9-4d24-8b5c-1a17ea8662a7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:53.409368 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-52e6bdeb-74e9-4d24-8b5c-1a17ea8662a7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:53.542758 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c46940ad-1c25-442f-a457-9957f939194c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "POST /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b/action" status: 202 len: 0 microversion: 2.20 time: 0.267434 Aug 05 10:29:53.543434 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 261/516] 10.222.0.40 () {62 vars in 1319 bytes} [Fri Aug 5 10:29:53 2022] POST /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:29:53.554097 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ad6c3e45-036a-4c9a-8546-6d573d163cc6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:53.554779 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ad6c3e45-036a-4c9a-8546-6d573d163cc6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:53.561510 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad6c3e45-036a-4c9a-8546-6d573d163cc6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:53.562014 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad6c3e45-036a-4c9a-8546-6d573d163cc6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:53.562477 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad6c3e45-036a-4c9a-8546-6d573d163cc6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:53.563200 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad6c3e45-036a-4c9a-8546-6d573d163cc6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:53.563647 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad6c3e45-036a-4c9a-8546-6d573d163cc6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:53.564090 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad6c3e45-036a-4c9a-8546-6d573d163cc6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:53.587798 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-52e6bdeb-74e9-4d24-8b5c-1a17ea8662a7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:53.598553 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-52e6bdeb-74e9-4d24-8b5c-1a17ea8662a7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1259 microversion: 2.1 time: 0.206658 Aug 05 10:29:53.599400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 256/517] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:53 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1259 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:53.715253 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ad6c3e45-036a-4c9a-8546-6d573d163cc6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:53.724148 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ad6c3e45-036a-4c9a-8546-6d573d163cc6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:53.725633 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ad6c3e45-036a-4c9a-8546-6d573d163cc6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:53.726961 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ad6c3e45-036a-4c9a-8546-6d573d163cc6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1724 microversion: 2.20 time: 0.177995 Aug 05 10:29:53.727520 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 262/518] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:29:53 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 10:29:54.276269 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-666c4768-0ff6-45bf-8e88-b77efa7df484 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:54.277060 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-666c4768-0ff6-45bf-8e88-b77efa7df484 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:54.286236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-666c4768-0ff6-45bf-8e88-b77efa7df484 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:54.286770 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-666c4768-0ff6-45bf-8e88-b77efa7df484 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:54.287246 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-666c4768-0ff6-45bf-8e88-b77efa7df484 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:54.287949 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-666c4768-0ff6-45bf-8e88-b77efa7df484 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:54.288410 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-666c4768-0ff6-45bf-8e88-b77efa7df484 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:54.288838 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-666c4768-0ff6-45bf-8e88-b77efa7df484 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:54.427791 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-666c4768-0ff6-45bf-8e88-b77efa7df484 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:54.436036 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-666c4768-0ff6-45bf-8e88-b77efa7df484 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1721 microversion: 2.1 time: 0.164860 Aug 05 10:29:54.436546 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 257/519] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:54 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:54.620154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f6d5641b-0055-47e4-b378-023895493ea0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:54.620760 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f6d5641b-0055-47e4-b378-023895493ea0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:54.627518 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6d5641b-0055-47e4-b378-023895493ea0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:54.627992 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6d5641b-0055-47e4-b378-023895493ea0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:54.628418 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6d5641b-0055-47e4-b378-023895493ea0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:54.629102 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6d5641b-0055-47e4-b378-023895493ea0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:54.629545 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6d5641b-0055-47e4-b378-023895493ea0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:54.629959 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6d5641b-0055-47e4-b378-023895493ea0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:54.750857 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-aaec83a4-dd23-46ee-b802-6c43f13e3ee5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:54.751711 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-aaec83a4-dd23-46ee-b802-6c43f13e3ee5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:54.758334 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aaec83a4-dd23-46ee-b802-6c43f13e3ee5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:54.758808 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aaec83a4-dd23-46ee-b802-6c43f13e3ee5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:54.759293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aaec83a4-dd23-46ee-b802-6c43f13e3ee5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:54.759996 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aaec83a4-dd23-46ee-b802-6c43f13e3ee5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:54.760434 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aaec83a4-dd23-46ee-b802-6c43f13e3ee5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:54.760859 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aaec83a4-dd23-46ee-b802-6c43f13e3ee5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:54.769663 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f6d5641b-0055-47e4-b378-023895493ea0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:54.778748 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f6d5641b-0055-47e4-b378-023895493ea0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1259 microversion: 2.1 time: 0.162514 Aug 05 10:29:54.779704 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 263/520] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:54 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:54.900775 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-aaec83a4-dd23-46ee-b802-6c43f13e3ee5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:54.909552 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-aaec83a4-dd23-46ee-b802-6c43f13e3ee5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:54.911188 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-aaec83a4-dd23-46ee-b802-6c43f13e3ee5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:54.912383 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-aaec83a4-dd23-46ee-b802-6c43f13e3ee5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1724 microversion: 2.20 time: 0.165819 Aug 05 10:29:54.913004 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 258/521] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:29:54 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:29:55.459360 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-71291f01-adcb-4709-8712-d988a520ba85 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:55.460120 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-71291f01-adcb-4709-8712-d988a520ba85 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:55.466848 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-71291f01-adcb-4709-8712-d988a520ba85 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:55.467374 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-71291f01-adcb-4709-8712-d988a520ba85 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:55.467806 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-71291f01-adcb-4709-8712-d988a520ba85 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:55.468546 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-71291f01-adcb-4709-8712-d988a520ba85 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:55.469345 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-71291f01-adcb-4709-8712-d988a520ba85 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:55.469768 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-71291f01-adcb-4709-8712-d988a520ba85 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:55.610747 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-71291f01-adcb-4709-8712-d988a520ba85 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:55.619380 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-71291f01-adcb-4709-8712-d988a520ba85 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1721 microversion: 2.1 time: 0.165328 Aug 05 10:29:55.619962 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 264/522] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:55 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:55.799724 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-2630d835-a8c6-41ad-85a4-fa0efdd405b1 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:55.800325 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-2630d835-a8c6-41ad-85a4-fa0efdd405b1 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:55.807579 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2630d835-a8c6-41ad-85a4-fa0efdd405b1 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:55.808061 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2630d835-a8c6-41ad-85a4-fa0efdd405b1 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:55.808484 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2630d835-a8c6-41ad-85a4-fa0efdd405b1 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:55.809176 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2630d835-a8c6-41ad-85a4-fa0efdd405b1 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:55.809620 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2630d835-a8c6-41ad-85a4-fa0efdd405b1 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:55.810029 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2630d835-a8c6-41ad-85a4-fa0efdd405b1 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:55.935851 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-de924c88-94c1-4617-b561-26a4b46f86d3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:55.936444 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-de924c88-94c1-4617-b561-26a4b46f86d3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:55.943023 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-de924c88-94c1-4617-b561-26a4b46f86d3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:55.943531 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-de924c88-94c1-4617-b561-26a4b46f86d3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:55.943964 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-de924c88-94c1-4617-b561-26a4b46f86d3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:55.944681 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-de924c88-94c1-4617-b561-26a4b46f86d3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:55.945310 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-de924c88-94c1-4617-b561-26a4b46f86d3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:55.945744 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-de924c88-94c1-4617-b561-26a4b46f86d3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:55.956347 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2630d835-a8c6-41ad-85a4-fa0efdd405b1 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:55.964902 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-2630d835-a8c6-41ad-85a4-fa0efdd405b1 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1259 microversion: 2.1 time: 0.168977 Aug 05 10:29:55.965472 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 259/523] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:55 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:56.083240 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-de924c88-94c1-4617-b561-26a4b46f86d3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:56.092240 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-de924c88-94c1-4617-b561-26a4b46f86d3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:56.093977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-de924c88-94c1-4617-b561-26a4b46f86d3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:56.095475 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-de924c88-94c1-4617-b561-26a4b46f86d3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1724 microversion: 2.20 time: 0.163348 Aug 05 10:29:56.096036 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 265/524] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:29:55 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:29:56.645136 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b128be30-943f-4f44-8eae-f72bb6e5c871 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:56.646124 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b128be30-943f-4f44-8eae-f72bb6e5c871 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:56.653986 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b128be30-943f-4f44-8eae-f72bb6e5c871 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:56.654471 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b128be30-943f-4f44-8eae-f72bb6e5c871 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:56.654924 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b128be30-943f-4f44-8eae-f72bb6e5c871 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:56.655634 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b128be30-943f-4f44-8eae-f72bb6e5c871 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:56.656076 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b128be30-943f-4f44-8eae-f72bb6e5c871 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:56.656502 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b128be30-943f-4f44-8eae-f72bb6e5c871 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:56.795780 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b128be30-943f-4f44-8eae-f72bb6e5c871 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:56.806959 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b128be30-943f-4f44-8eae-f72bb6e5c871 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1721 microversion: 2.1 time: 0.167943 Aug 05 10:29:56.807631 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 260/525] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:56 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:56.992243 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cab7be60-4864-41f5-b8f5-1d354cefa855 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:56.992833 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cab7be60-4864-41f5-b8f5-1d354cefa855 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:57.000620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cab7be60-4864-41f5-b8f5-1d354cefa855 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:57.001100 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cab7be60-4864-41f5-b8f5-1d354cefa855 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:57.001616 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cab7be60-4864-41f5-b8f5-1d354cefa855 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:57.002639 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cab7be60-4864-41f5-b8f5-1d354cefa855 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:57.003524 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cab7be60-4864-41f5-b8f5-1d354cefa855 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:57.004249 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cab7be60-4864-41f5-b8f5-1d354cefa855 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:57.121633 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d936fbae-63fa-43f2-bf77-895d71026067 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:57.122406 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d936fbae-63fa-43f2-bf77-895d71026067 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:57.130211 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d936fbae-63fa-43f2-bf77-895d71026067 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:57.130938 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d936fbae-63fa-43f2-bf77-895d71026067 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:57.131558 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d936fbae-63fa-43f2-bf77-895d71026067 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:57.132934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d936fbae-63fa-43f2-bf77-895d71026067 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:57.133567 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d936fbae-63fa-43f2-bf77-895d71026067 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:57.134146 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d936fbae-63fa-43f2-bf77-895d71026067 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:57.142786 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cab7be60-4864-41f5-b8f5-1d354cefa855 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:57.147293 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:29:57.152552 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cab7be60-4864-41f5-b8f5-1d354cefa855 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1259 microversion: 2.1 time: 0.167525 Aug 05 10:29:57.166598 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 266/526] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:56 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:57.277409 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d936fbae-63fa-43f2-bf77-895d71026067 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:57.281013 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:29:57.286915 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d936fbae-63fa-43f2-bf77-895d71026067 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:57.288657 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d936fbae-63fa-43f2-bf77-895d71026067 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:57.290829 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d936fbae-63fa-43f2-bf77-895d71026067 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1724 microversion: 2.20 time: 0.175005 Aug 05 10:29:57.291454 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 261/527] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:29:57 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:29:57.831307 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ef344f1f-6796-4bad-a523-4f16f1caa85e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:57.832208 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ef344f1f-6796-4bad-a523-4f16f1caa85e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:57.845573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ef344f1f-6796-4bad-a523-4f16f1caa85e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:57.846339 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ef344f1f-6796-4bad-a523-4f16f1caa85e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:57.847703 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ef344f1f-6796-4bad-a523-4f16f1caa85e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:57.848859 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ef344f1f-6796-4bad-a523-4f16f1caa85e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:57.849597 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ef344f1f-6796-4bad-a523-4f16f1caa85e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:57.850290 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ef344f1f-6796-4bad-a523-4f16f1caa85e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:57.992418 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ef344f1f-6796-4bad-a523-4f16f1caa85e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:58.001488 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ef344f1f-6796-4bad-a523-4f16f1caa85e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1721 microversion: 2.1 time: 0.175871 Aug 05 10:29:58.002046 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 267/528] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:57 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:58.177879 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ea1a9fef-8846-46b8-9cbb-1f4847bcf879 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:58.178832 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-ea1a9fef-8846-46b8-9cbb-1f4847bcf879 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:58.187858 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ea1a9fef-8846-46b8-9cbb-1f4847bcf879 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:58.188368 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ea1a9fef-8846-46b8-9cbb-1f4847bcf879 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:58.188801 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ea1a9fef-8846-46b8-9cbb-1f4847bcf879 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:58.189545 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ea1a9fef-8846-46b8-9cbb-1f4847bcf879 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:58.189992 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ea1a9fef-8846-46b8-9cbb-1f4847bcf879 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:58.190411 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ea1a9fef-8846-46b8-9cbb-1f4847bcf879 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:58.313852 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9b47b9a7-d202-4344-a1f5-533edf6733fb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:58.314474 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9b47b9a7-d202-4344-a1f5-533edf6733fb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:58.320436 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9b47b9a7-d202-4344-a1f5-533edf6733fb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:58.320908 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9b47b9a7-d202-4344-a1f5-533edf6733fb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:58.321333 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9b47b9a7-d202-4344-a1f5-533edf6733fb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:58.322008 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9b47b9a7-d202-4344-a1f5-533edf6733fb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:58.322450 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9b47b9a7-d202-4344-a1f5-533edf6733fb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:58.322859 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9b47b9a7-d202-4344-a1f5-533edf6733fb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:58.341017 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ea1a9fef-8846-46b8-9cbb-1f4847bcf879 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:58.348813 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ea1a9fef-8846-46b8-9cbb-1f4847bcf879 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1259 microversion: 2.1 time: 0.177508 Aug 05 10:29:58.349634 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 262/529] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:58 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:58.470245 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9b47b9a7-d202-4344-a1f5-533edf6733fb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:58.478731 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9b47b9a7-d202-4344-a1f5-533edf6733fb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:58.480266 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9b47b9a7-d202-4344-a1f5-533edf6733fb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:58.481397 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9b47b9a7-d202-4344-a1f5-533edf6733fb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1724 microversion: 2.20 time: 0.171430 Aug 05 10:29:58.481950 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 268/530] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:29:58 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:29:58.917782 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-9cf7ca33-064b-4a02-a58a-c5853800d08e req-427d6f6f-ff44-4438-a578-9940897a2747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b987816b-37ef-46a2-b94e-5c3954662b58", "name": "network-vif-plugged", "status": "completed", "tag": "b38f7bd7-6d1e-4b76-8780-abac7a1bd11a"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:29:58.927567 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-9cf7ca33-064b-4a02-a58a-c5853800d08e req-427d6f6f-ff44-4438-a578-9940897a2747 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:58.928042 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-9cf7ca33-064b-4a02-a58a-c5853800d08e req-427d6f6f-ff44-4438-a578-9940897a2747 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:58.928786 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-9cf7ca33-064b-4a02-a58a-c5853800d08e req-427d6f6f-ff44-4438-a578-9940897a2747 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:58.941150 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-9cf7ca33-064b-4a02-a58a-c5853800d08e req-427d6f6f-ff44-4438-a578-9940897a2747 service nova] Creating event network-vif-plugged:b38f7bd7-6d1e-4b76-8780-abac7a1bd11a for instance b987816b-37ef-46a2-b94e-5c3954662b58 on hv-cinder-81558 Aug 05 10:29:58.946547 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-9cf7ca33-064b-4a02-a58a-c5853800d08e req-427d6f6f-ff44-4438-a578-9940897a2747 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033106 Aug 05 10:29:58.947156 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 263/531] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:29:59.021820 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-25f0c83f-3347-4d7f-bcb9-8601cc4b1739 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:59.022407 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-25f0c83f-3347-4d7f-bcb9-8601cc4b1739 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:59.029125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-25f0c83f-3347-4d7f-bcb9-8601cc4b1739 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:59.029598 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-25f0c83f-3347-4d7f-bcb9-8601cc4b1739 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:59.030034 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-25f0c83f-3347-4d7f-bcb9-8601cc4b1739 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:59.030717 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-25f0c83f-3347-4d7f-bcb9-8601cc4b1739 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:59.031200 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-25f0c83f-3347-4d7f-bcb9-8601cc4b1739 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:59.031972 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-25f0c83f-3347-4d7f-bcb9-8601cc4b1739 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:59.180349 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-25f0c83f-3347-4d7f-bcb9-8601cc4b1739 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:59.189388 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-25f0c83f-3347-4d7f-bcb9-8601cc4b1739 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1721 microversion: 2.1 time: 0.171514 Aug 05 10:29:59.189956 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 269/532] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:59 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:59.371577 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-02f02d98-593d-4ba6-8cf4-1b03a77eb7f0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:59.372142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-02f02d98-593d-4ba6-8cf4-1b03a77eb7f0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:59.378934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02f02d98-593d-4ba6-8cf4-1b03a77eb7f0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:59.379418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02f02d98-593d-4ba6-8cf4-1b03a77eb7f0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:59.379859 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02f02d98-593d-4ba6-8cf4-1b03a77eb7f0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:59.380551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02f02d98-593d-4ba6-8cf4-1b03a77eb7f0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:59.381007 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02f02d98-593d-4ba6-8cf4-1b03a77eb7f0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:59.381427 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02f02d98-593d-4ba6-8cf4-1b03a77eb7f0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:59.507981 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bc37055b-333e-4c96-9b03-dff3b57c6888 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:29:59.508733 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bc37055b-333e-4c96-9b03-dff3b57c6888 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:29:59.515124 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc37055b-333e-4c96-9b03-dff3b57c6888 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:59.515620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc37055b-333e-4c96-9b03-dff3b57c6888 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:59.516018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc37055b-333e-4c96-9b03-dff3b57c6888 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:59.516731 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc37055b-333e-4c96-9b03-dff3b57c6888 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:29:59.517437 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc37055b-333e-4c96-9b03-dff3b57c6888 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:29:59.517739 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc37055b-333e-4c96-9b03-dff3b57c6888 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:29:59.529704 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-02f02d98-593d-4ba6-8cf4-1b03a77eb7f0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:59.538274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-02f02d98-593d-4ba6-8cf4-1b03a77eb7f0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1259 microversion: 2.1 time: 0.171671 Aug 05 10:29:59.538851 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 264/533] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:29:59 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:29:59.656893 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bc37055b-333e-4c96-9b03-dff3b57c6888 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:59.669573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bc37055b-333e-4c96-9b03-dff3b57c6888 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:59.671776 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bc37055b-333e-4c96-9b03-dff3b57c6888 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:29:59.673490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bc37055b-333e-4c96-9b03-dff3b57c6888 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1724 microversion: 2.20 time: 0.169172 Aug 05 10:29:59.674252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 270/534] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:29:59 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:00.211295 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-8b731da8-f017-4d3d-afad-db62d9d9fc8a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:00.211953 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-8b731da8-f017-4d3d-afad-db62d9d9fc8a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:00.218550 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8b731da8-f017-4d3d-afad-db62d9d9fc8a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:00.219063 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8b731da8-f017-4d3d-afad-db62d9d9fc8a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:00.219501 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8b731da8-f017-4d3d-afad-db62d9d9fc8a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:00.220193 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8b731da8-f017-4d3d-afad-db62d9d9fc8a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:00.220652 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8b731da8-f017-4d3d-afad-db62d9d9fc8a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:00.221078 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8b731da8-f017-4d3d-afad-db62d9d9fc8a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:00.362293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-8b731da8-f017-4d3d-afad-db62d9d9fc8a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:00.372645 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-8b731da8-f017-4d3d-afad-db62d9d9fc8a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1721 microversion: 2.1 time: 0.165412 Aug 05 10:30:00.373291 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 265/535] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:00 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:00.562404 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4cf958ce-6218-47bc-ba82-d0e1a55f4b87 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:00.563039 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4cf958ce-6218-47bc-ba82-d0e1a55f4b87 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:00.572216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4cf958ce-6218-47bc-ba82-d0e1a55f4b87 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:00.572723 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4cf958ce-6218-47bc-ba82-d0e1a55f4b87 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:00.573172 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4cf958ce-6218-47bc-ba82-d0e1a55f4b87 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:00.573892 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4cf958ce-6218-47bc-ba82-d0e1a55f4b87 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:00.574371 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4cf958ce-6218-47bc-ba82-d0e1a55f4b87 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:00.574809 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4cf958ce-6218-47bc-ba82-d0e1a55f4b87 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:00.699718 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ad23ee3f-9cbf-400f-8cf9-0c3ac23edc4c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:00.700322 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-ad23ee3f-9cbf-400f-8cf9-0c3ac23edc4c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:00.707081 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ad23ee3f-9cbf-400f-8cf9-0c3ac23edc4c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:00.707564 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ad23ee3f-9cbf-400f-8cf9-0c3ac23edc4c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:00.708027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ad23ee3f-9cbf-400f-8cf9-0c3ac23edc4c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:00.708700 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ad23ee3f-9cbf-400f-8cf9-0c3ac23edc4c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:00.709141 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ad23ee3f-9cbf-400f-8cf9-0c3ac23edc4c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:00.709562 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ad23ee3f-9cbf-400f-8cf9-0c3ac23edc4c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:00.721558 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4cf958ce-6218-47bc-ba82-d0e1a55f4b87 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:00.729636 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4cf958ce-6218-47bc-ba82-d0e1a55f4b87 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1259 microversion: 2.1 time: 0.172884 Aug 05 10:30:00.730317 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 271/536] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:00 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:00.843040 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ad23ee3f-9cbf-400f-8cf9-0c3ac23edc4c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:00.851413 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ad23ee3f-9cbf-400f-8cf9-0c3ac23edc4c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:00.853521 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ad23ee3f-9cbf-400f-8cf9-0c3ac23edc4c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:00.854695 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ad23ee3f-9cbf-400f-8cf9-0c3ac23edc4c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1724 microversion: 2.20 time: 0.159279 Aug 05 10:30:00.855273 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 266/537] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:00 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:01.397776 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-218c8bee-2b23-42a1-b7bd-df16cbe2fcfc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:01.398637 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-218c8bee-2b23-42a1-b7bd-df16cbe2fcfc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:01.405475 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-218c8bee-2b23-42a1-b7bd-df16cbe2fcfc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:01.405949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-218c8bee-2b23-42a1-b7bd-df16cbe2fcfc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:01.406739 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-218c8bee-2b23-42a1-b7bd-df16cbe2fcfc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:01.407469 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-218c8bee-2b23-42a1-b7bd-df16cbe2fcfc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:01.407920 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-218c8bee-2b23-42a1-b7bd-df16cbe2fcfc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:01.408328 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-218c8bee-2b23-42a1-b7bd-df16cbe2fcfc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:01.538039 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-218c8bee-2b23-42a1-b7bd-df16cbe2fcfc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:01.546568 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-218c8bee-2b23-42a1-b7bd-df16cbe2fcfc tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1721 microversion: 2.1 time: 0.155407 Aug 05 10:30:01.547139 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 272/538] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:01 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:01.755949 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d8ed8da4-8363-47ca-acda-26ca9e61e3cc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:01.756939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d8ed8da4-8363-47ca-acda-26ca9e61e3cc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:01.764576 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d8ed8da4-8363-47ca-acda-26ca9e61e3cc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:01.765047 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d8ed8da4-8363-47ca-acda-26ca9e61e3cc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:01.765472 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d8ed8da4-8363-47ca-acda-26ca9e61e3cc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:01.766160 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d8ed8da4-8363-47ca-acda-26ca9e61e3cc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:01.766602 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d8ed8da4-8363-47ca-acda-26ca9e61e3cc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:01.767052 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d8ed8da4-8363-47ca-acda-26ca9e61e3cc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:01.877905 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dafbcda2-57c0-4ad6-a4db-098cda83a60c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:01.878502 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dafbcda2-57c0-4ad6-a4db-098cda83a60c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:01.885507 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dafbcda2-57c0-4ad6-a4db-098cda83a60c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:01.885988 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dafbcda2-57c0-4ad6-a4db-098cda83a60c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:01.886415 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dafbcda2-57c0-4ad6-a4db-098cda83a60c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:01.887135 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dafbcda2-57c0-4ad6-a4db-098cda83a60c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:01.887578 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dafbcda2-57c0-4ad6-a4db-098cda83a60c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:01.887992 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dafbcda2-57c0-4ad6-a4db-098cda83a60c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:01.912619 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d8ed8da4-8363-47ca-acda-26ca9e61e3cc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:01.920718 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d8ed8da4-8363-47ca-acda-26ca9e61e3cc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1259 microversion: 2.1 time: 0.171966 Aug 05 10:30:01.921305 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 267/539] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:01 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:02.033315 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dafbcda2-57c0-4ad6-a4db-098cda83a60c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:02.042033 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dafbcda2-57c0-4ad6-a4db-098cda83a60c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:02.043558 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dafbcda2-57c0-4ad6-a4db-098cda83a60c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:02.045079 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dafbcda2-57c0-4ad6-a4db-098cda83a60c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1724 microversion: 2.20 time: 0.171247 Aug 05 10:30:02.045645 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 273/540] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:01 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:02.114086 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c3ff1b51-9e16-4502-b1ea-1294a30554de tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Action: 'create', calling method: .version_select at 0x7f7327654940>, body: {"keypair": {"name": "tempest-keypair-1921313331", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDON+Ob2dxxJqOj57TCmbEezBLAAtrnkZISZTh5Fpngm7W0nQopt1hAO1xyA8TmsVSea8NjmusyLW+4GnyYmFeRhn2dCTPlkG0fogCzsynnlvGKFaOah6Mw1RpJ/Ren2cQ=="}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:30:02.132140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-c3ff1b51-9e16-4502-b1ea-1294a30554de tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Getting quotas for project 588c79a0604e49f49123980f0e9af63a. Resources: {'key_pairs'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:30:02.136455 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-c3ff1b51-9e16-4502-b1ea-1294a30554de tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Getting quotas for user 706dbfa719c04fd0a3704ebd7eb812cd and project 588c79a0604e49f49123980f0e9af63a. Resources: {'key_pairs'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:30:02.174330 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c3ff1b51-9e16-4502-b1ea-1294a30554de tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.067314 Aug 05 10:30:02.175163 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 268/541] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 5 10:30:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:30:02.569196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-90f5d4b1-ae7e-44f9-a52c-508b0d1decf7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:02.570185 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-90f5d4b1-ae7e-44f9-a52c-508b0d1decf7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:02.577120 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90f5d4b1-ae7e-44f9-a52c-508b0d1decf7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:02.577593 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90f5d4b1-ae7e-44f9-a52c-508b0d1decf7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:02.578020 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90f5d4b1-ae7e-44f9-a52c-508b0d1decf7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:02.578785 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90f5d4b1-ae7e-44f9-a52c-508b0d1decf7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:02.579302 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90f5d4b1-ae7e-44f9-a52c-508b0d1decf7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:02.579716 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90f5d4b1-ae7e-44f9-a52c-508b0d1decf7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:02.792045 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-90f5d4b1-ae7e-44f9-a52c-508b0d1decf7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:02.801548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-90f5d4b1-ae7e-44f9-a52c-508b0d1decf7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1721 microversion: 2.1 time: 0.237968 Aug 05 10:30:02.802516 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 274/542] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:02 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:02.941533 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-00b6f809-581b-4589-b9ba-23639378112a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:02.942119 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-00b6f809-581b-4589-b9ba-23639378112a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:02.949232 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-00b6f809-581b-4589-b9ba-23639378112a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:02.949705 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-00b6f809-581b-4589-b9ba-23639378112a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:02.950130 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-00b6f809-581b-4589-b9ba-23639378112a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:02.950813 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-00b6f809-581b-4589-b9ba-23639378112a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:02.951323 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-00b6f809-581b-4589-b9ba-23639378112a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:02.951739 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-00b6f809-581b-4589-b9ba-23639378112a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:03.069131 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c20b3c25-c0b6-4cd4-b171-5759c6aa0ccd tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:03.069744 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c20b3c25-c0b6-4cd4-b171-5759c6aa0ccd tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:03.077383 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c20b3c25-c0b6-4cd4-b171-5759c6aa0ccd tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:03.077842 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c20b3c25-c0b6-4cd4-b171-5759c6aa0ccd tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:03.078447 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c20b3c25-c0b6-4cd4-b171-5759c6aa0ccd tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:03.079421 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c20b3c25-c0b6-4cd4-b171-5759c6aa0ccd tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:03.079877 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c20b3c25-c0b6-4cd4-b171-5759c6aa0ccd tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:03.080328 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c20b3c25-c0b6-4cd4-b171-5759c6aa0ccd tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:03.088957 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-00b6f809-581b-4589-b9ba-23639378112a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:03.097566 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-00b6f809-581b-4589-b9ba-23639378112a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1259 microversion: 2.1 time: 0.159748 Aug 05 10:30:03.098408 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 269/543] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:02 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:03.280746 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c20b3c25-c0b6-4cd4-b171-5759c6aa0ccd tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:03.289588 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c20b3c25-c0b6-4cd4-b171-5759c6aa0ccd tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:03.291457 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c20b3c25-c0b6-4cd4-b171-5759c6aa0ccd tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:03.292627 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c20b3c25-c0b6-4cd4-b171-5759c6aa0ccd tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1724 microversion: 2.20 time: 0.227391 Aug 05 10:30:03.293229 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 275/544] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:03 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:03.668103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-aa956d97-08df-4a5a-97d6-d77201ef755f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1876227425", "imageRef": "6163bb7c-dfd7-4fb1-a3cb-9f4818243f78", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "35d63aef-17c7-4ac5-9809-c80ac951c47d"}], "security_groups": [{"name": "tempest-securitygroup--1058501371"}], "key_name": "tempest-keypair-1921313331", "user_data": "}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:30:03.778728 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.network.neutron [None req-aa956d97-08df-4a5a-97d6-d77201ef755f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] validate_networks() for [('35d63aef-17c7-4ac5-9809-c80ac951c47d', None, None, None, None, None)] {{(pid=117831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 10:30:03.823994 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d64dc175-181c-44f2-adcb-704df7205693 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:03.824627 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d64dc175-181c-44f2-adcb-704df7205693 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:03.831001 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d64dc175-181c-44f2-adcb-704df7205693 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:03.831481 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d64dc175-181c-44f2-adcb-704df7205693 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:03.831889 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d64dc175-181c-44f2-adcb-704df7205693 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:03.832576 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d64dc175-181c-44f2-adcb-704df7205693 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:03.833021 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d64dc175-181c-44f2-adcb-704df7205693 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:03.833440 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d64dc175-181c-44f2-adcb-704df7205693 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:03.964036 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d64dc175-181c-44f2-adcb-704df7205693 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:03.972800 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d64dc175-181c-44f2-adcb-704df7205693 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1721 microversion: 2.1 time: 0.153204 Aug 05 10:30:03.973606 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 276/545] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:03 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:04.117845 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8386cd1f-6361-4279-b229-08f533062c79 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:04.118741 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8386cd1f-6361-4279-b229-08f533062c79 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:04.125711 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8386cd1f-6361-4279-b229-08f533062c79 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:04.126224 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8386cd1f-6361-4279-b229-08f533062c79 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:04.126657 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8386cd1f-6361-4279-b229-08f533062c79 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:04.127399 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8386cd1f-6361-4279-b229-08f533062c79 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:04.127846 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8386cd1f-6361-4279-b229-08f533062c79 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:04.128270 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8386cd1f-6361-4279-b229-08f533062c79 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:04.163761 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-aa956d97-08df-4a5a-97d6-d77201ef755f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Flavor limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 10:30:04.164172 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-aa956d97-08df-4a5a-97d6-d77201ef755f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Image limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 10:30:04.164634 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-aa956d97-08df-4a5a-97d6-d77201ef755f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Flavor pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 10:30:04.165038 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-aa956d97-08df-4a5a-97d6-d77201ef755f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Image pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 10:30:04.165590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-aa956d97-08df-4a5a-97d6-d77201ef755f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 10:30:04.174691 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aa956d97-08df-4a5a-97d6-d77201ef755f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:04.175208 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aa956d97-08df-4a5a-97d6-d77201ef755f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:04.175642 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aa956d97-08df-4a5a-97d6-d77201ef755f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:04.176368 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aa956d97-08df-4a5a-97d6-d77201ef755f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:04.176818 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aa956d97-08df-4a5a-97d6-d77201ef755f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:04.177239 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aa956d97-08df-4a5a-97d6-d77201ef755f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:04.194447 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-aa956d97-08df-4a5a-97d6-d77201ef755f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Getting quotas for project 588c79a0604e49f49123980f0e9af63a. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:30:04.199040 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-aa956d97-08df-4a5a-97d6-d77201ef755f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Getting quotas for user 706dbfa719c04fd0a3704ebd7eb812cd and project 588c79a0604e49f49123980f0e9af63a. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:30:04.210472 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-aa956d97-08df-4a5a-97d6-d77201ef755f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Going to run 1 instances... {{(pid=117831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 10:30:04.213029 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-aa956d97-08df-4a5a-97d6-d77201ef755f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6163bb7c-dfd7-4fb1-a3cb-9f4818243f78',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 10:30:04.260547 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-aa956d97-08df-4a5a-97d6-d77201ef755f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.597451 Aug 05 10:30:04.266986 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 270/546] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 10:30:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 10:30:04.272327 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-8edad542-0450-4b00-a0e9-fd046c6c7390 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:04.273283 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-8edad542-0450-4b00-a0e9-fd046c6c7390 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:04.340342 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-8edad542-0450-4b00-a0e9-fd046c6c7390 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:04.347940 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-8edad542-0450-4b00-a0e9-fd046c6c7390 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 200 len: 1242 microversion: 2.1 time: 0.079335 Aug 05 10:30:04.348634 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 271/547] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:04 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:30:04.354149 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-934ed39a-4dd1-4e5d-9200-adf2e456253a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:04.355067 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-934ed39a-4dd1-4e5d-9200-adf2e456253a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:04.365953 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-934ed39a-4dd1-4e5d-9200-adf2e456253a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:04.366536 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-934ed39a-4dd1-4e5d-9200-adf2e456253a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:04.367164 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-934ed39a-4dd1-4e5d-9200-adf2e456253a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:04.368091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-934ed39a-4dd1-4e5d-9200-adf2e456253a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:04.368734 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-934ed39a-4dd1-4e5d-9200-adf2e456253a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:04.369167 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-934ed39a-4dd1-4e5d-9200-adf2e456253a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:04.525556 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-934ed39a-4dd1-4e5d-9200-adf2e456253a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:04.527648 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8386cd1f-6361-4279-b229-08f533062c79 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:04.535211 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-934ed39a-4dd1-4e5d-9200-adf2e456253a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:04.536104 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8386cd1f-6361-4279-b229-08f533062c79 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1444 microversion: 2.1 time: 0.422113 Aug 05 10:30:04.537109 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-934ed39a-4dd1-4e5d-9200-adf2e456253a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:04.538635 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-934ed39a-4dd1-4e5d-9200-adf2e456253a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1724 microversion: 2.20 time: 0.188848 Aug 05 10:30:04.539456 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 272/548] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:04 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:04.547411 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 277/549] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:04 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1444 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:04.556676 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b9a7d624-a0d6-4879-b5c4-3075e3c2fda3 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:04.557335 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b9a7d624-a0d6-4879-b5c4-3075e3c2fda3 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:04.564064 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b9a7d624-a0d6-4879-b5c4-3075e3c2fda3 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:04.564571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b9a7d624-a0d6-4879-b5c4-3075e3c2fda3 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:04.565013 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b9a7d624-a0d6-4879-b5c4-3075e3c2fda3 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:04.565840 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b9a7d624-a0d6-4879-b5c4-3075e3c2fda3 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:04.566327 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b9a7d624-a0d6-4879-b5c4-3075e3c2fda3 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:04.566755 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b9a7d624-a0d6-4879-b5c4-3075e3c2fda3 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:04.708853 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b9a7d624-a0d6-4879-b5c4-3075e3c2fda3 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:04.718174 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b9a7d624-a0d6-4879-b5c4-3075e3c2fda3 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1444 microversion: 2.1 time: 0.165806 Aug 05 10:30:04.718826 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 273/550] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:04 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1444 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:04.997001 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b2d8ef42-5cee-417c-86dc-8312ffc0da78 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:04.997711 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b2d8ef42-5cee-417c-86dc-8312ffc0da78 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:05.005263 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2d8ef42-5cee-417c-86dc-8312ffc0da78 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:05.005741 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2d8ef42-5cee-417c-86dc-8312ffc0da78 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:05.006167 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2d8ef42-5cee-417c-86dc-8312ffc0da78 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:05.006864 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2d8ef42-5cee-417c-86dc-8312ffc0da78 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:05.007371 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2d8ef42-5cee-417c-86dc-8312ffc0da78 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:05.007785 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2d8ef42-5cee-417c-86dc-8312ffc0da78 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:05.150844 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b2d8ef42-5cee-417c-86dc-8312ffc0da78 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:05.162207 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b2d8ef42-5cee-417c-86dc-8312ffc0da78 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1721 microversion: 2.1 time: 0.169684 Aug 05 10:30:05.164033 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 278/551] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:04 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:05.370217 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-54685351-7017-4957-b181-ff28575bbe98 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:05.383222 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-54685351-7017-4957-b181-ff28575bbe98 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:05.383222 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:30:05.383222 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-54685351-7017-4957-b181-ff28575bbe98 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:05.383222 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-54685351-7017-4957-b181-ff28575bbe98 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:05.383939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-54685351-7017-4957-b181-ff28575bbe98 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:05.383939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-54685351-7017-4957-b181-ff28575bbe98 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:05.383939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-54685351-7017-4957-b181-ff28575bbe98 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:05.383939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-54685351-7017-4957-b181-ff28575bbe98 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:05.471080 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-54685351-7017-4957-b181-ff28575bbe98 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:05.479287 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-54685351-7017-4957-b181-ff28575bbe98 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 200 len: 1294 microversion: 2.1 time: 0.112870 Aug 05 10:30:05.483212 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 274/552] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:05 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 1294 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:05.562624 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0a708c03-80ec-4809-85eb-494c755a577d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:05.563259 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0a708c03-80ec-4809-85eb-494c755a577d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:05.569713 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a708c03-80ec-4809-85eb-494c755a577d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:05.570506 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a708c03-80ec-4809-85eb-494c755a577d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:05.570683 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a708c03-80ec-4809-85eb-494c755a577d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:05.571438 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a708c03-80ec-4809-85eb-494c755a577d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:05.571960 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a708c03-80ec-4809-85eb-494c755a577d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:05.572300 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a708c03-80ec-4809-85eb-494c755a577d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:05.718728 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0a708c03-80ec-4809-85eb-494c755a577d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:05.729497 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0a708c03-80ec-4809-85eb-494c755a577d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:05.731291 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0a708c03-80ec-4809-85eb-494c755a577d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:05.732670 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0a708c03-80ec-4809-85eb-494c755a577d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1724 microversion: 2.20 time: 0.174097 Aug 05 10:30:05.733310 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 279/553] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:05 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:06.184190 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-7c15338f-9812-4ad4-8b1f-bf390e78b0a9 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:06.185018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-7c15338f-9812-4ad4-8b1f-bf390e78b0a9 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:06.191471 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7c15338f-9812-4ad4-8b1f-bf390e78b0a9 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:06.192033 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7c15338f-9812-4ad4-8b1f-bf390e78b0a9 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:06.192628 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7c15338f-9812-4ad4-8b1f-bf390e78b0a9 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:06.193377 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7c15338f-9812-4ad4-8b1f-bf390e78b0a9 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:06.193829 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7c15338f-9812-4ad4-8b1f-bf390e78b0a9 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:06.194247 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7c15338f-9812-4ad4-8b1f-bf390e78b0a9 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:06.479661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-7c15338f-9812-4ad4-8b1f-bf390e78b0a9 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:06.488177 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-7c15338f-9812-4ad4-8b1f-bf390e78b0a9 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1721 microversion: 2.1 time: 0.307975 Aug 05 10:30:06.488882 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 275/554] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:06 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1721 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:06.500262 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1d8bb4cb-fdc0-4041-85bd-c337beec0e5b tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:06.501013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1d8bb4cb-fdc0-4041-85bd-c337beec0e5b tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:06.507764 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d8bb4cb-fdc0-4041-85bd-c337beec0e5b tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:06.508242 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d8bb4cb-fdc0-4041-85bd-c337beec0e5b tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:06.508701 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d8bb4cb-fdc0-4041-85bd-c337beec0e5b tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:06.509777 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d8bb4cb-fdc0-4041-85bd-c337beec0e5b tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:06.510225 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d8bb4cb-fdc0-4041-85bd-c337beec0e5b tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:06.510659 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d8bb4cb-fdc0-4041-85bd-c337beec0e5b tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:06.574713 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1d8bb4cb-fdc0-4041-85bd-c337beec0e5b tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:06.582381 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1d8bb4cb-fdc0-4041-85bd-c337beec0e5b tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 200 len: 1300 microversion: 2.1 time: 0.085990 Aug 05 10:30:06.583067 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 280/555] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:06 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 1300 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:06.756564 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-52f70349-280d-45b6-bc36-3d4a04295c12 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:06.757179 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-52f70349-280d-45b6-bc36-3d4a04295c12 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:06.764625 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-52f70349-280d-45b6-bc36-3d4a04295c12 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:06.765119 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-52f70349-280d-45b6-bc36-3d4a04295c12 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:06.765554 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-52f70349-280d-45b6-bc36-3d4a04295c12 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:06.766434 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-52f70349-280d-45b6-bc36-3d4a04295c12 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:06.766869 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-52f70349-280d-45b6-bc36-3d4a04295c12 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:06.767327 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-52f70349-280d-45b6-bc36-3d4a04295c12 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:07.067590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-52f70349-280d-45b6-bc36-3d4a04295c12 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:07.076244 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-52f70349-280d-45b6-bc36-3d4a04295c12 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:07.077850 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-52f70349-280d-45b6-bc36-3d4a04295c12 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:07.079143 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-52f70349-280d-45b6-bc36-3d4a04295c12 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1724 microversion: 2.20 time: 0.326667 Aug 05 10:30:07.079783 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 276/556] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:06 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1724 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:07.509806 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cdecee9e-d1b5-4677-b1e5-0270190c91a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:07.510594 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cdecee9e-d1b5-4677-b1e5-0270190c91a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:07.517808 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdecee9e-d1b5-4677-b1e5-0270190c91a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:07.521413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdecee9e-d1b5-4677-b1e5-0270190c91a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:07.521413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdecee9e-d1b5-4677-b1e5-0270190c91a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:07.521413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdecee9e-d1b5-4677-b1e5-0270190c91a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:07.521413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdecee9e-d1b5-4677-b1e5-0270190c91a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:07.522025 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdecee9e-d1b5-4677-b1e5-0270190c91a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:07.531965 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-3bb06261-b71d-4c5a-adea-f7cf9a0eab58 req-fbe3fd10-977b-4039-96d7-84c60ff5ec80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b987816b-37ef-46a2-b94e-5c3954662b58", "tag": "b38f7bd7-6d1e-4b76-8780-abac7a1bd11a"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:30:07.549202 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-3bb06261-b71d-4c5a-adea-f7cf9a0eab58 req-fbe3fd10-977b-4039-96d7-84c60ff5ec80 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:07.549998 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-3bb06261-b71d-4c5a-adea-f7cf9a0eab58 req-fbe3fd10-977b-4039-96d7-84c60ff5ec80 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:07.550804 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-3bb06261-b71d-4c5a-adea-f7cf9a0eab58 req-fbe3fd10-977b-4039-96d7-84c60ff5ec80 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:07.569254 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-3bb06261-b71d-4c5a-adea-f7cf9a0eab58 req-fbe3fd10-977b-4039-96d7-84c60ff5ec80 service nova] Creating event network-changed:b38f7bd7-6d1e-4b76-8780-abac7a1bd11a for instance b987816b-37ef-46a2-b94e-5c3954662b58 on hv-cinder-81558 Aug 05 10:30:07.577317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-3bb06261-b71d-4c5a-adea-f7cf9a0eab58 req-fbe3fd10-977b-4039-96d7-84c60ff5ec80 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049774 Aug 05 10:30:07.578605 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 277/557] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:30:07.606245 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-8322d16a-4c62-4257-bd9c-8cf85030f0ee tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:07.607272 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-8322d16a-4c62-4257-bd9c-8cf85030f0ee tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:07.617977 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8322d16a-4c62-4257-bd9c-8cf85030f0ee tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:07.618795 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8322d16a-4c62-4257-bd9c-8cf85030f0ee tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:07.619414 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8322d16a-4c62-4257-bd9c-8cf85030f0ee tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:07.620303 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8322d16a-4c62-4257-bd9c-8cf85030f0ee tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:07.620925 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8322d16a-4c62-4257-bd9c-8cf85030f0ee tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:07.621491 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8322d16a-4c62-4257-bd9c-8cf85030f0ee tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:07.685014 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cdecee9e-d1b5-4677-b1e5-0270190c91a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:07.694072 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cdecee9e-d1b5-4677-b1e5-0270190c91a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1721 microversion: 2.1 time: 0.188286 Aug 05 10:30:07.695127 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 281/558] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:07 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:07.949104 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-8322d16a-4c62-4257-bd9c-8cf85030f0ee tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:07.957939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-8322d16a-4c62-4257-bd9c-8cf85030f0ee tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 200 len: 1368 microversion: 2.1 time: 0.357908 Aug 05 10:30:07.959360 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 278/559] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:07 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 1368 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:30:08.102094 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3865c80c-a345-4ac1-be5a-130011192208 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:08.103042 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3865c80c-a345-4ac1-be5a-130011192208 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:08.109848 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3865c80c-a345-4ac1-be5a-130011192208 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:08.110947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3865c80c-a345-4ac1-be5a-130011192208 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:08.111754 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3865c80c-a345-4ac1-be5a-130011192208 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:08.113157 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3865c80c-a345-4ac1-be5a-130011192208 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:08.113824 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3865c80c-a345-4ac1-be5a-130011192208 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:08.115111 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3865c80c-a345-4ac1-be5a-130011192208 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:08.262492 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3865c80c-a345-4ac1-be5a-130011192208 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:08.272104 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3865c80c-a345-4ac1-be5a-130011192208 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:08.273891 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3865c80c-a345-4ac1-be5a-130011192208 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:08.275833 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3865c80c-a345-4ac1-be5a-130011192208 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1724 microversion: 2.20 time: 0.177692 Aug 05 10:30:08.276837 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 282/560] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:08 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:08.724103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-e2e12915-581e-4fee-ac4f-ae21e25cf413 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:08.724638 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-e2e12915-581e-4fee-ac4f-ae21e25cf413 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:08.731606 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e2e12915-581e-4fee-ac4f-ae21e25cf413 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:08.732093 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e2e12915-581e-4fee-ac4f-ae21e25cf413 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:08.732525 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e2e12915-581e-4fee-ac4f-ae21e25cf413 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:08.733224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e2e12915-581e-4fee-ac4f-ae21e25cf413 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:08.733665 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e2e12915-581e-4fee-ac4f-ae21e25cf413 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:08.734083 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e2e12915-581e-4fee-ac4f-ae21e25cf413 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:08.981644 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ee23d328-dab4-4d62-9c6b-996d7de91257 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:08.984233 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ee23d328-dab4-4d62-9c6b-996d7de91257 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:08.996592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ee23d328-dab4-4d62-9c6b-996d7de91257 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:08.998068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ee23d328-dab4-4d62-9c6b-996d7de91257 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:08.998704 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ee23d328-dab4-4d62-9c6b-996d7de91257 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:09.000397 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ee23d328-dab4-4d62-9c6b-996d7de91257 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:09.001678 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ee23d328-dab4-4d62-9c6b-996d7de91257 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:09.002218 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ee23d328-dab4-4d62-9c6b-996d7de91257 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:09.013296 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e2e12915-581e-4fee-ac4f-ae21e25cf413 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:09.026345 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-e2e12915-581e-4fee-ac4f-ae21e25cf413 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1721 microversion: 2.1 time: 0.306037 Aug 05 10:30:09.036100 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:30:09.040419 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 279/561] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:08 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1721 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:09.178109 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ee23d328-dab4-4d62-9c6b-996d7de91257 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:09.186440 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ee23d328-dab4-4d62-9c6b-996d7de91257 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 200 len: 1368 microversion: 2.1 time: 0.209488 Aug 05 10:30:09.187350 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 283/562] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:08 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:09.299517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-47f6940c-bd21-42fa-b002-f1455b8866d6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:09.300128 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-47f6940c-bd21-42fa-b002-f1455b8866d6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:09.306534 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-47f6940c-bd21-42fa-b002-f1455b8866d6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:09.307047 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-47f6940c-bd21-42fa-b002-f1455b8866d6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:09.307484 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-47f6940c-bd21-42fa-b002-f1455b8866d6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:09.308476 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-47f6940c-bd21-42fa-b002-f1455b8866d6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:09.308929 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-47f6940c-bd21-42fa-b002-f1455b8866d6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:09.309381 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-47f6940c-bd21-42fa-b002-f1455b8866d6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:09.519520 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-47f6940c-bd21-42fa-b002-f1455b8866d6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:09.527779 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-47f6940c-bd21-42fa-b002-f1455b8866d6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:09.529309 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-47f6940c-bd21-42fa-b002-f1455b8866d6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:09.530502 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-47f6940c-bd21-42fa-b002-f1455b8866d6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1724 microversion: 2.20 time: 0.234901 Aug 05 10:30:09.531106 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 280/563] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:09 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:09.594077 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-6b88fcbc-92e5-4761-b7cd-c25544189cf4 req-c56ba286-6f00-4e55-9088-f8fa16ae30f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3", "tag": "fe9efa99-2628-4877-9bb9-0064315a40ca"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:30:09.604267 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-6b88fcbc-92e5-4761-b7cd-c25544189cf4 req-c56ba286-6f00-4e55-9088-f8fa16ae30f3 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:09.604861 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-6b88fcbc-92e5-4761-b7cd-c25544189cf4 req-c56ba286-6f00-4e55-9088-f8fa16ae30f3 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:09.605379 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-6b88fcbc-92e5-4761-b7cd-c25544189cf4 req-c56ba286-6f00-4e55-9088-f8fa16ae30f3 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:09.616665 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-6b88fcbc-92e5-4761-b7cd-c25544189cf4 req-c56ba286-6f00-4e55-9088-f8fa16ae30f3 service nova] Creating event network-changed:fe9efa99-2628-4877-9bb9-0064315a40ca for instance 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 on hv-cinder-81558 Aug 05 10:30:09.622770 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-6b88fcbc-92e5-4761-b7cd-c25544189cf4 req-c56ba286-6f00-4e55-9088-f8fa16ae30f3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033161 Aug 05 10:30:09.623385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 284/564] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:30:10.053686 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c1f90671-7a36-4ada-a3b6-b23dbe42a824 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:10.054686 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c1f90671-7a36-4ada-a3b6-b23dbe42a824 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:10.065681 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c1f90671-7a36-4ada-a3b6-b23dbe42a824 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:10.066477 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c1f90671-7a36-4ada-a3b6-b23dbe42a824 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:10.067262 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c1f90671-7a36-4ada-a3b6-b23dbe42a824 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:10.068396 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c1f90671-7a36-4ada-a3b6-b23dbe42a824 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:10.069155 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c1f90671-7a36-4ada-a3b6-b23dbe42a824 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:10.069855 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c1f90671-7a36-4ada-a3b6-b23dbe42a824 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:10.202454 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c1f90671-7a36-4ada-a3b6-b23dbe42a824 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:10.208780 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cdaa3fb6-4a05-4599-ac2c-b481866307fc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:10.209467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cdaa3fb6-4a05-4599-ac2c-b481866307fc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:10.210669 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c1f90671-7a36-4ada-a3b6-b23dbe42a824 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1698 microversion: 2.1 time: 0.163511 Aug 05 10:30:10.211686 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 281/565] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:10 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1698 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:10.212272 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=71 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:30:10.216785 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdaa3fb6-4a05-4599-ac2c-b481866307fc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:10.217257 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdaa3fb6-4a05-4599-ac2c-b481866307fc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:10.217654 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdaa3fb6-4a05-4599-ac2c-b481866307fc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:10.218351 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdaa3fb6-4a05-4599-ac2c-b481866307fc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:10.218796 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdaa3fb6-4a05-4599-ac2c-b481866307fc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:10.219239 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdaa3fb6-4a05-4599-ac2c-b481866307fc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:10.231495 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-55db03b1-8ce4-4350-8af4-f43c441d49ee tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:30:10.237659 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-55db03b1-8ce4-4350-8af4-f43c441d49ee tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:10.238148 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-55db03b1-8ce4-4350-8af4-f43c441d49ee tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:10.238582 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-55db03b1-8ce4-4350-8af4-f43c441d49ee tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:10.292783 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=100 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:30:10.299646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-55db03b1-8ce4-4350-8af4-f43c441d49ee tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Going to try to start instance {{(pid=117831) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 05 10:30:10.345181 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-55db03b1-8ce4-4350-8af4-f43c441d49ee tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "POST /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a/action" status: 202 len: 0 microversion: 2.1 time: 0.117660 Aug 05 10:30:10.345701 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 282/566] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 10:30:10 2022] POST /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 10:30:10.354014 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-6c07d857-24da-48f0-a6c9-db4ed6a51940 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:10.354170 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cdaa3fb6-4a05-4599-ac2c-b481866307fc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:10.354766 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-6c07d857-24da-48f0-a6c9-db4ed6a51940 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:10.360997 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6c07d857-24da-48f0-a6c9-db4ed6a51940 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:10.361480 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6c07d857-24da-48f0-a6c9-db4ed6a51940 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:10.361625 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cdaa3fb6-4a05-4599-ac2c-b481866307fc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 200 len: 1368 microversion: 2.1 time: 0.157528 Aug 05 10:30:10.361921 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6c07d857-24da-48f0-a6c9-db4ed6a51940 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:10.362147 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 285/567] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:10 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:30:10.362662 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6c07d857-24da-48f0-a6c9-db4ed6a51940 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:10.363141 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6c07d857-24da-48f0-a6c9-db4ed6a51940 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:10.363563 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6c07d857-24da-48f0-a6c9-db4ed6a51940 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:10.513749 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-6c07d857-24da-48f0-a6c9-db4ed6a51940 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:10.522542 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-6c07d857-24da-48f0-a6c9-db4ed6a51940 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1707 microversion: 2.1 time: 0.172572 Aug 05 10:30:10.523153 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 283/568] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:10 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1707 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:10.553803 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-df3d7a22-62d8-45f3-a34f-9b690086d170 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:10.554402 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-df3d7a22-62d8-45f3-a34f-9b690086d170 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:10.561020 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df3d7a22-62d8-45f3-a34f-9b690086d170 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:10.561497 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df3d7a22-62d8-45f3-a34f-9b690086d170 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:10.561922 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df3d7a22-62d8-45f3-a34f-9b690086d170 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:10.562607 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df3d7a22-62d8-45f3-a34f-9b690086d170 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:10.563094 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df3d7a22-62d8-45f3-a34f-9b690086d170 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:10.563510 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df3d7a22-62d8-45f3-a34f-9b690086d170 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:10.696965 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-df3d7a22-62d8-45f3-a34f-9b690086d170 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:10.705317 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-df3d7a22-62d8-45f3-a34f-9b690086d170 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:10.706785 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-df3d7a22-62d8-45f3-a34f-9b690086d170 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:10.708022 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-df3d7a22-62d8-45f3-a34f-9b690086d170 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1724 microversion: 2.20 time: 0.158188 Aug 05 10:30:10.708572 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 286/569] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:10 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:11.386875 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-4b93c869-1fc0-499b-89b8-f728822e403f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:11.387532 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-4b93c869-1fc0-499b-89b8-f728822e403f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:11.395473 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4b93c869-1fc0-499b-89b8-f728822e403f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:11.396036 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4b93c869-1fc0-499b-89b8-f728822e403f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:11.396537 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4b93c869-1fc0-499b-89b8-f728822e403f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:11.397344 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4b93c869-1fc0-499b-89b8-f728822e403f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:11.397870 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4b93c869-1fc0-499b-89b8-f728822e403f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:11.398356 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4b93c869-1fc0-499b-89b8-f728822e403f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:11.544260 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-52e9e5e7-8309-43c1-9561-df086de46a00 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:11.545029 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-52e9e5e7-8309-43c1-9561-df086de46a00 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:11.551076 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-4b93c869-1fc0-499b-89b8-f728822e403f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:11.552117 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52e9e5e7-8309-43c1-9561-df086de46a00 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:11.552598 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52e9e5e7-8309-43c1-9561-df086de46a00 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:11.553023 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52e9e5e7-8309-43c1-9561-df086de46a00 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:11.553717 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52e9e5e7-8309-43c1-9561-df086de46a00 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:11.554162 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52e9e5e7-8309-43c1-9561-df086de46a00 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:11.554576 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-52e9e5e7-8309-43c1-9561-df086de46a00 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:11.559375 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-4b93c869-1fc0-499b-89b8-f728822e403f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 200 len: 1368 microversion: 2.1 time: 0.178203 Aug 05 10:30:11.560352 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 284/570] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:11 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:11.700766 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-52e9e5e7-8309-43c1-9561-df086de46a00 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:11.709330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-52e9e5e7-8309-43c1-9561-df086de46a00 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1707 microversion: 2.1 time: 0.169230 Aug 05 10:30:11.709910 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 287/571] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:11 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1707 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:11.737306 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-3733aadb-086d-4f6f-a6fb-e277c0788a20 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:11.737907 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-3733aadb-086d-4f6f-a6fb-e277c0788a20 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:11.744192 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3733aadb-086d-4f6f-a6fb-e277c0788a20 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:11.744869 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3733aadb-086d-4f6f-a6fb-e277c0788a20 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:11.745176 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3733aadb-086d-4f6f-a6fb-e277c0788a20 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:11.745872 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3733aadb-086d-4f6f-a6fb-e277c0788a20 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:11.746315 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3733aadb-086d-4f6f-a6fb-e277c0788a20 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:11.746730 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3733aadb-086d-4f6f-a6fb-e277c0788a20 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:11.904067 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-3733aadb-086d-4f6f-a6fb-e277c0788a20 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:11.912578 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-3733aadb-086d-4f6f-a6fb-e277c0788a20 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:11.914072 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-3733aadb-086d-4f6f-a6fb-e277c0788a20 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:11.915246 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-3733aadb-086d-4f6f-a6fb-e277c0788a20 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1724 microversion: 2.20 time: 0.181815 Aug 05 10:30:11.915801 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 285/572] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:11 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:12.584451 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-39fed132-58c2-4c78-b36c-f29c7ca6a0b7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:12.585405 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-39fed132-58c2-4c78-b36c-f29c7ca6a0b7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:12.595477 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39fed132-58c2-4c78-b36c-f29c7ca6a0b7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:12.595959 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39fed132-58c2-4c78-b36c-f29c7ca6a0b7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:12.596422 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39fed132-58c2-4c78-b36c-f29c7ca6a0b7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:12.597107 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39fed132-58c2-4c78-b36c-f29c7ca6a0b7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:12.597556 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39fed132-58c2-4c78-b36c-f29c7ca6a0b7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:12.597973 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39fed132-58c2-4c78-b36c-f29c7ca6a0b7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:12.730944 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-3824b868-3728-4a26-86e1-ce3a37bfea61 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:12.731549 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-3824b868-3728-4a26-86e1-ce3a37bfea61 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:12.737794 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3824b868-3728-4a26-86e1-ce3a37bfea61 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:12.738435 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3824b868-3728-4a26-86e1-ce3a37bfea61 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:12.738925 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3824b868-3728-4a26-86e1-ce3a37bfea61 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:12.739615 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3824b868-3728-4a26-86e1-ce3a37bfea61 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:12.740095 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3824b868-3728-4a26-86e1-ce3a37bfea61 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:12.740488 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3824b868-3728-4a26-86e1-ce3a37bfea61 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:12.742105 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-39fed132-58c2-4c78-b36c-f29c7ca6a0b7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:12.750770 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-39fed132-58c2-4c78-b36c-f29c7ca6a0b7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 200 len: 1368 microversion: 2.1 time: 0.172842 Aug 05 10:30:12.751803 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 288/573] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:12 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:12.877237 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-3824b868-3728-4a26-86e1-ce3a37bfea61 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:12.885465 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-3824b868-3728-4a26-86e1-ce3a37bfea61 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1707 microversion: 2.1 time: 0.159534 Aug 05 10:30:12.886277 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 286/574] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:12 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1707 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:30:12.940434 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1279dcb9-7492-4324-81d6-5a3b6f72df44 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:12.941256 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1279dcb9-7492-4324-81d6-5a3b6f72df44 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:12.949947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1279dcb9-7492-4324-81d6-5a3b6f72df44 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:12.950425 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1279dcb9-7492-4324-81d6-5a3b6f72df44 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:12.950853 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1279dcb9-7492-4324-81d6-5a3b6f72df44 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:12.951582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1279dcb9-7492-4324-81d6-5a3b6f72df44 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:12.952044 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1279dcb9-7492-4324-81d6-5a3b6f72df44 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:12.952448 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1279dcb9-7492-4324-81d6-5a3b6f72df44 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:13.087331 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1279dcb9-7492-4324-81d6-5a3b6f72df44 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:13.096857 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1279dcb9-7492-4324-81d6-5a3b6f72df44 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:13.098379 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1279dcb9-7492-4324-81d6-5a3b6f72df44 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:13.099557 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1279dcb9-7492-4324-81d6-5a3b6f72df44 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1724 microversion: 2.20 time: 0.165367 Aug 05 10:30:13.100093 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 289/575] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:12 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:13.771803 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-59fd39ce-a491-4f5b-9696-d9ee45115ce1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:13.772423 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-59fd39ce-a491-4f5b-9696-d9ee45115ce1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:13.779662 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-59fd39ce-a491-4f5b-9696-d9ee45115ce1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:13.780136 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-59fd39ce-a491-4f5b-9696-d9ee45115ce1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:13.780567 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-59fd39ce-a491-4f5b-9696-d9ee45115ce1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:13.781592 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-59fd39ce-a491-4f5b-9696-d9ee45115ce1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:13.782036 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-59fd39ce-a491-4f5b-9696-d9ee45115ce1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:13.782439 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-59fd39ce-a491-4f5b-9696-d9ee45115ce1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:13.908707 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-34989564-5469-4b0c-bd12-5f616049359b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:13.909297 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-34989564-5469-4b0c-bd12-5f616049359b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:13.916085 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34989564-5469-4b0c-bd12-5f616049359b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:13.916598 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34989564-5469-4b0c-bd12-5f616049359b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:13.917095 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34989564-5469-4b0c-bd12-5f616049359b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:13.917791 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34989564-5469-4b0c-bd12-5f616049359b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:13.918233 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34989564-5469-4b0c-bd12-5f616049359b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:13.918647 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34989564-5469-4b0c-bd12-5f616049359b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:14.029005 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-59fd39ce-a491-4f5b-9696-d9ee45115ce1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:14.040890 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-59fd39ce-a491-4f5b-9696-d9ee45115ce1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 200 len: 1368 microversion: 2.1 time: 0.273029 Aug 05 10:30:14.041759 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 287/576] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:13 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 1368 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:14.069085 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-34989564-5469-4b0c-bd12-5f616049359b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:14.077889 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-34989564-5469-4b0c-bd12-5f616049359b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1707 microversion: 2.1 time: 0.174729 Aug 05 10:30:14.078458 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 290/577] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:13 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1707 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:14.123320 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-008674b8-4a1d-4bec-afc2-f754caf31215 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:14.123958 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-008674b8-4a1d-4bec-afc2-f754caf31215 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:14.130216 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-008674b8-4a1d-4bec-afc2-f754caf31215 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:14.130793 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-008674b8-4a1d-4bec-afc2-f754caf31215 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:14.131274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-008674b8-4a1d-4bec-afc2-f754caf31215 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:14.131988 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-008674b8-4a1d-4bec-afc2-f754caf31215 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:14.132436 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-008674b8-4a1d-4bec-afc2-f754caf31215 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:14.132870 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-008674b8-4a1d-4bec-afc2-f754caf31215 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:14.185217 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=2 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:30:14.346561 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=12 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:30:14.417696 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-008674b8-4a1d-4bec-afc2-f754caf31215 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:14.426766 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-008674b8-4a1d-4bec-afc2-f754caf31215 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:14.428280 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-008674b8-4a1d-4bec-afc2-f754caf31215 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:14.429431 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-008674b8-4a1d-4bec-afc2-f754caf31215 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1724 microversion: 2.20 time: 0.310473 Aug 05 10:30:14.429990 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 288/578] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:14 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1724 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:15.063921 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2b0a6828-4c18-43fc-9555-5eff2d81f954 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:15.064529 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2b0a6828-4c18-43fc-9555-5eff2d81f954 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:15.072221 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b0a6828-4c18-43fc-9555-5eff2d81f954 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:15.072906 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b0a6828-4c18-43fc-9555-5eff2d81f954 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:15.073518 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b0a6828-4c18-43fc-9555-5eff2d81f954 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:15.074614 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b0a6828-4c18-43fc-9555-5eff2d81f954 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:15.075408 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b0a6828-4c18-43fc-9555-5eff2d81f954 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:15.076106 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b0a6828-4c18-43fc-9555-5eff2d81f954 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:15.099988 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-afe7cc0d-cdc6-4c00-b5ed-7cb1e65eff03 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:15.100595 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-afe7cc0d-cdc6-4c00-b5ed-7cb1e65eff03 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:15.117551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-afe7cc0d-cdc6-4c00-b5ed-7cb1e65eff03 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:15.118043 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-afe7cc0d-cdc6-4c00-b5ed-7cb1e65eff03 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:15.118464 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-afe7cc0d-cdc6-4c00-b5ed-7cb1e65eff03 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:15.119263 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-afe7cc0d-cdc6-4c00-b5ed-7cb1e65eff03 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:15.119714 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-afe7cc0d-cdc6-4c00-b5ed-7cb1e65eff03 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:15.120118 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-afe7cc0d-cdc6-4c00-b5ed-7cb1e65eff03 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:15.240949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2b0a6828-4c18-43fc-9555-5eff2d81f954 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:15.249545 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2b0a6828-4c18-43fc-9555-5eff2d81f954 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 200 len: 1368 microversion: 2.1 time: 0.189698 Aug 05 10:30:15.250122 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 291/579] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:15 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:15.366105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-afe7cc0d-cdc6-4c00-b5ed-7cb1e65eff03 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:15.375646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-afe7cc0d-cdc6-4c00-b5ed-7cb1e65eff03 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1707 microversion: 2.1 time: 0.279521 Aug 05 10:30:15.376188 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 289/580] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:15 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1707 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:15.457554 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b6606da3-d915-4ac5-ae56-730f111e726d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:15.458586 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b6606da3-d915-4ac5-ae56-730f111e726d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:15.468203 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b6606da3-d915-4ac5-ae56-730f111e726d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:15.468682 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b6606da3-d915-4ac5-ae56-730f111e726d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:15.469100 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b6606da3-d915-4ac5-ae56-730f111e726d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:15.469782 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b6606da3-d915-4ac5-ae56-730f111e726d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:15.470221 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b6606da3-d915-4ac5-ae56-730f111e726d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:15.470637 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b6606da3-d915-4ac5-ae56-730f111e726d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:15.616482 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b6606da3-d915-4ac5-ae56-730f111e726d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:15.629293 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b6606da3-d915-4ac5-ae56-730f111e726d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:15.631609 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b6606da3-d915-4ac5-ae56-730f111e726d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:15.633264 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b6606da3-d915-4ac5-ae56-730f111e726d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1724 microversion: 2.20 time: 0.182190 Aug 05 10:30:15.634031 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 292/581] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:15 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:16.270355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-e49ae6f3-d1bd-4379-b719-2324960c33ae tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:16.272073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-e49ae6f3-d1bd-4379-b719-2324960c33ae tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:16.278938 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e49ae6f3-d1bd-4379-b719-2324960c33ae tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:16.279466 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e49ae6f3-d1bd-4379-b719-2324960c33ae tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:16.280185 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e49ae6f3-d1bd-4379-b719-2324960c33ae tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:16.281431 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e49ae6f3-d1bd-4379-b719-2324960c33ae tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:16.282008 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e49ae6f3-d1bd-4379-b719-2324960c33ae tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:16.282433 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e49ae6f3-d1bd-4379-b719-2324960c33ae tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:16.397347 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e9a1da50-ad36-4afd-a4de-be9cef2d31e6 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:16.398566 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e9a1da50-ad36-4afd-a4de-be9cef2d31e6 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:16.405781 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9a1da50-ad36-4afd-a4de-be9cef2d31e6 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:16.406447 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9a1da50-ad36-4afd-a4de-be9cef2d31e6 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:16.406878 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9a1da50-ad36-4afd-a4de-be9cef2d31e6 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:16.407590 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9a1da50-ad36-4afd-a4de-be9cef2d31e6 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:16.408134 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9a1da50-ad36-4afd-a4de-be9cef2d31e6 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:16.408427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9a1da50-ad36-4afd-a4de-be9cef2d31e6 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:16.423361 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e49ae6f3-d1bd-4379-b719-2324960c33ae tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:16.432425 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-e49ae6f3-d1bd-4379-b719-2324960c33ae tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 200 len: 1368 microversion: 2.1 time: 0.166533 Aug 05 10:30:16.432999 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 290/582] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:16 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:16.556878 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e9a1da50-ad36-4afd-a4de-be9cef2d31e6 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:16.565775 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e9a1da50-ad36-4afd-a4de-be9cef2d31e6 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1707 microversion: 2.1 time: 0.172413 Aug 05 10:30:16.566345 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 293/583] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:16 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1707 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:16.659453 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-450b10b7-a723-4082-930c-692f2e4b302b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:16.660067 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-450b10b7-a723-4082-930c-692f2e4b302b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:16.666893 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-450b10b7-a723-4082-930c-692f2e4b302b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:16.667424 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-450b10b7-a723-4082-930c-692f2e4b302b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:16.667861 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-450b10b7-a723-4082-930c-692f2e4b302b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:16.668549 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-450b10b7-a723-4082-930c-692f2e4b302b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:16.669005 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-450b10b7-a723-4082-930c-692f2e4b302b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:16.669445 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-450b10b7-a723-4082-930c-692f2e4b302b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:16.815665 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-450b10b7-a723-4082-930c-692f2e4b302b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:16.827893 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-450b10b7-a723-4082-930c-692f2e4b302b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:16.830145 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-450b10b7-a723-4082-930c-692f2e4b302b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:16.831869 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-450b10b7-a723-4082-930c-692f2e4b302b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1745 microversion: 2.20 time: 0.177431 Aug 05 10:30:16.832538 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 291/584] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:16 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:17.456055 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cc43128d-9229-401d-9910-c5719bfa44cd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:17.456636 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cc43128d-9229-401d-9910-c5719bfa44cd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:17.463931 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc43128d-9229-401d-9910-c5719bfa44cd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:17.464550 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc43128d-9229-401d-9910-c5719bfa44cd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:17.464988 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc43128d-9229-401d-9910-c5719bfa44cd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:17.465825 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc43128d-9229-401d-9910-c5719bfa44cd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:17.466337 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc43128d-9229-401d-9910-c5719bfa44cd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:17.466846 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc43128d-9229-401d-9910-c5719bfa44cd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:17.588174 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-e0636d4d-dcb0-4280-91f2-932eec7a2c2a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:17.589396 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-e0636d4d-dcb0-4280-91f2-932eec7a2c2a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:17.596063 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e0636d4d-dcb0-4280-91f2-932eec7a2c2a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:17.596555 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e0636d4d-dcb0-4280-91f2-932eec7a2c2a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:17.596993 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e0636d4d-dcb0-4280-91f2-932eec7a2c2a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:17.597691 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e0636d4d-dcb0-4280-91f2-932eec7a2c2a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:17.598355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e0636d4d-dcb0-4280-91f2-932eec7a2c2a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:17.599005 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e0636d4d-dcb0-4280-91f2-932eec7a2c2a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:17.632027 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cc43128d-9229-401d-9910-c5719bfa44cd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:17.671632 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cc43128d-9229-401d-9910-c5719bfa44cd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 200 len: 1368 microversion: 2.1 time: 0.207952 Aug 05 10:30:17.672418 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 294/585] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:17 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:17.759082 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e0636d4d-dcb0-4280-91f2-932eec7a2c2a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:17.768398 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-e0636d4d-dcb0-4280-91f2-932eec7a2c2a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1707 microversion: 2.1 time: 0.183972 Aug 05 10:30:17.769051 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 292/586] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:17 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1707 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:17.861587 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d211b11c-d8bb-458e-a62c-4c0fa828b135 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:17.862187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d211b11c-d8bb-458e-a62c-4c0fa828b135 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:17.868579 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d211b11c-d8bb-458e-a62c-4c0fa828b135 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:17.869053 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d211b11c-d8bb-458e-a62c-4c0fa828b135 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:17.869478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d211b11c-d8bb-458e-a62c-4c0fa828b135 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:17.870152 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d211b11c-d8bb-458e-a62c-4c0fa828b135 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:17.870596 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d211b11c-d8bb-458e-a62c-4c0fa828b135 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:17.871073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d211b11c-d8bb-458e-a62c-4c0fa828b135 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:18.009534 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d211b11c-d8bb-458e-a62c-4c0fa828b135 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:18.017730 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d211b11c-d8bb-458e-a62c-4c0fa828b135 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:18.019266 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d211b11c-d8bb-458e-a62c-4c0fa828b135 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:18.020650 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d211b11c-d8bb-458e-a62c-4c0fa828b135 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1745 microversion: 2.20 time: 0.164982 Aug 05 10:30:18.021218 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 295/587] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:17 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:18.162682 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-287de15e-40fe-47d4-af48-1c9e1c04b0a8 req-4db293e9-f428-4dcd-99ef-4d51b4b9596b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3", "name": "network-vif-plugged", "status": "completed", "tag": "fe9efa99-2628-4877-9bb9-0064315a40ca"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:30:18.184865 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-287de15e-40fe-47d4-af48-1c9e1c04b0a8 req-4db293e9-f428-4dcd-99ef-4d51b4b9596b service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:18.185356 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-287de15e-40fe-47d4-af48-1c9e1c04b0a8 req-4db293e9-f428-4dcd-99ef-4d51b4b9596b service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:18.185830 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-287de15e-40fe-47d4-af48-1c9e1c04b0a8 req-4db293e9-f428-4dcd-99ef-4d51b4b9596b service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:18.199089 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-287de15e-40fe-47d4-af48-1c9e1c04b0a8 req-4db293e9-f428-4dcd-99ef-4d51b4b9596b service nova] Creating event network-vif-plugged:fe9efa99-2628-4877-9bb9-0064315a40ca for instance 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 on hv-cinder-81558 Aug 05 10:30:18.207482 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-287de15e-40fe-47d4-af48-1c9e1c04b0a8 req-4db293e9-f428-4dcd-99ef-4d51b4b9596b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049584 Aug 05 10:30:18.208326 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 293/588] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:30:18.693959 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d763a194-528a-432d-a557-5b25ed0dc71b tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:18.694581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d763a194-528a-432d-a557-5b25ed0dc71b tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:18.701736 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d763a194-528a-432d-a557-5b25ed0dc71b tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:18.702271 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d763a194-528a-432d-a557-5b25ed0dc71b tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:18.702861 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d763a194-528a-432d-a557-5b25ed0dc71b tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:18.703640 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d763a194-528a-432d-a557-5b25ed0dc71b tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:18.704092 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d763a194-528a-432d-a557-5b25ed0dc71b tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:18.704515 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d763a194-528a-432d-a557-5b25ed0dc71b tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:18.790281 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-a89c29d8-d631-4c66-be65-b0b55e852b91 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:18.790997 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-a89c29d8-d631-4c66-be65-b0b55e852b91 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:18.798272 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a89c29d8-d631-4c66-be65-b0b55e852b91 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:18.798846 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a89c29d8-d631-4c66-be65-b0b55e852b91 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:18.799419 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a89c29d8-d631-4c66-be65-b0b55e852b91 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:18.801652 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a89c29d8-d631-4c66-be65-b0b55e852b91 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:18.801652 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a89c29d8-d631-4c66-be65-b0b55e852b91 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:18.801652 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a89c29d8-d631-4c66-be65-b0b55e852b91 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:18.849038 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d763a194-528a-432d-a557-5b25ed0dc71b tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:18.856838 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d763a194-528a-432d-a557-5b25ed0dc71b tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 200 len: 1368 microversion: 2.1 time: 0.166840 Aug 05 10:30:18.857411 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 296/589] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:18 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:18.935837 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a89c29d8-d631-4c66-be65-b0b55e852b91 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:18.944489 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-a89c29d8-d631-4c66-be65-b0b55e852b91 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1711 microversion: 2.1 time: 0.158447 Aug 05 10:30:18.945032 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 294/590] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:18 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1711 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:19.048909 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-004f523c-6019-440b-a9f6-5e4059b9d14d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:19.049509 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-004f523c-6019-440b-a9f6-5e4059b9d14d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:19.056090 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-004f523c-6019-440b-a9f6-5e4059b9d14d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:19.056552 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-004f523c-6019-440b-a9f6-5e4059b9d14d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:19.057043 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-004f523c-6019-440b-a9f6-5e4059b9d14d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:19.057742 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-004f523c-6019-440b-a9f6-5e4059b9d14d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:19.058230 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-004f523c-6019-440b-a9f6-5e4059b9d14d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:19.058652 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-004f523c-6019-440b-a9f6-5e4059b9d14d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:19.194065 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-004f523c-6019-440b-a9f6-5e4059b9d14d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:19.202256 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-004f523c-6019-440b-a9f6-5e4059b9d14d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:19.203792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-004f523c-6019-440b-a9f6-5e4059b9d14d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:19.204946 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-004f523c-6019-440b-a9f6-5e4059b9d14d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1745 microversion: 2.20 time: 0.160059 Aug 05 10:30:19.205512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 297/591] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:19 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:19.877471 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-0474a184-279d-4101-82f9-376064a023c0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:19.878108 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-0474a184-279d-4101-82f9-376064a023c0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:19.884661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0474a184-279d-4101-82f9-376064a023c0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:19.885137 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0474a184-279d-4101-82f9-376064a023c0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:19.885774 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0474a184-279d-4101-82f9-376064a023c0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:19.886454 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0474a184-279d-4101-82f9-376064a023c0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:19.886894 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0474a184-279d-4101-82f9-376064a023c0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:19.889163 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0474a184-279d-4101-82f9-376064a023c0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:20.037825 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-0474a184-279d-4101-82f9-376064a023c0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:20.045547 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-0474a184-279d-4101-82f9-376064a023c0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 200 len: 1368 microversion: 2.1 time: 0.171963 Aug 05 10:30:20.046110 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 295/592] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:19 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:20.228696 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bcf62493-49e6-4411-813b-cebb3099b11a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:20.229274 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bcf62493-49e6-4411-813b-cebb3099b11a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:20.237023 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bcf62493-49e6-4411-813b-cebb3099b11a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:20.237512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bcf62493-49e6-4411-813b-cebb3099b11a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:20.237930 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bcf62493-49e6-4411-813b-cebb3099b11a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:20.238621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bcf62493-49e6-4411-813b-cebb3099b11a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:20.239170 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bcf62493-49e6-4411-813b-cebb3099b11a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:20.239596 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bcf62493-49e6-4411-813b-cebb3099b11a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:20.372286 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bcf62493-49e6-4411-813b-cebb3099b11a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:20.380613 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bcf62493-49e6-4411-813b-cebb3099b11a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:20.382100 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bcf62493-49e6-4411-813b-cebb3099b11a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:20.383265 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bcf62493-49e6-4411-813b-cebb3099b11a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1745 microversion: 2.20 time: 0.158964 Aug 05 10:30:20.383817 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 298/593] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:20 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:21.066217 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-7bf7a1f5-86c1-4bf5-87f5-003ce6a8e956 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:21.067504 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-7bf7a1f5-86c1-4bf5-87f5-003ce6a8e956 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:21.074488 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7bf7a1f5-86c1-4bf5-87f5-003ce6a8e956 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:21.074997 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7bf7a1f5-86c1-4bf5-87f5-003ce6a8e956 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:21.075450 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7bf7a1f5-86c1-4bf5-87f5-003ce6a8e956 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:21.076145 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7bf7a1f5-86c1-4bf5-87f5-003ce6a8e956 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:21.077006 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7bf7a1f5-86c1-4bf5-87f5-003ce6a8e956 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:21.077157 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7bf7a1f5-86c1-4bf5-87f5-003ce6a8e956 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:21.223994 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-7bf7a1f5-86c1-4bf5-87f5-003ce6a8e956 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:21.231696 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-7bf7a1f5-86c1-4bf5-87f5-003ce6a8e956 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 200 len: 1368 microversion: 2.1 time: 0.169488 Aug 05 10:30:21.232251 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 296/594] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:21 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:21.406975 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fcce8154-7677-46ce-8708-618b21b50461 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:21.407545 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fcce8154-7677-46ce-8708-618b21b50461 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:21.415990 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fcce8154-7677-46ce-8708-618b21b50461 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:21.416834 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fcce8154-7677-46ce-8708-618b21b50461 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:21.417602 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fcce8154-7677-46ce-8708-618b21b50461 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:21.418811 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fcce8154-7677-46ce-8708-618b21b50461 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:21.419693 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fcce8154-7677-46ce-8708-618b21b50461 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:21.421100 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fcce8154-7677-46ce-8708-618b21b50461 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:21.578417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fcce8154-7677-46ce-8708-618b21b50461 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:21.587002 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fcce8154-7677-46ce-8708-618b21b50461 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:21.588504 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fcce8154-7677-46ce-8708-618b21b50461 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:21.589671 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fcce8154-7677-46ce-8708-618b21b50461 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1745 microversion: 2.20 time: 0.187608 Aug 05 10:30:21.590228 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 299/595] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:21 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1745 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:22.255164 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d0b2f361-ffdf-42e1-a6d4-b379cc182b21 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:22.255960 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d0b2f361-ffdf-42e1-a6d4-b379cc182b21 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:22.264969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d0b2f361-ffdf-42e1-a6d4-b379cc182b21 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:22.265767 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d0b2f361-ffdf-42e1-a6d4-b379cc182b21 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:22.266343 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d0b2f361-ffdf-42e1-a6d4-b379cc182b21 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:22.267311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d0b2f361-ffdf-42e1-a6d4-b379cc182b21 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:22.267903 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d0b2f361-ffdf-42e1-a6d4-b379cc182b21 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:22.268464 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d0b2f361-ffdf-42e1-a6d4-b379cc182b21 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:22.408837 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d0b2f361-ffdf-42e1-a6d4-b379cc182b21 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:22.420497 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d0b2f361-ffdf-42e1-a6d4-b379cc182b21 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 200 len: 1368 microversion: 2.1 time: 0.170254 Aug 05 10:30:22.420997 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 297/596] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:22 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:22.613889 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1ef6fe4e-3d52-4545-bc21-f6a9eb2999d0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:22.614521 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1ef6fe4e-3d52-4545-bc21-f6a9eb2999d0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:22.622315 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1ef6fe4e-3d52-4545-bc21-f6a9eb2999d0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:22.622886 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1ef6fe4e-3d52-4545-bc21-f6a9eb2999d0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:22.623606 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1ef6fe4e-3d52-4545-bc21-f6a9eb2999d0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:22.624755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1ef6fe4e-3d52-4545-bc21-f6a9eb2999d0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:22.625259 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1ef6fe4e-3d52-4545-bc21-f6a9eb2999d0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:22.625725 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1ef6fe4e-3d52-4545-bc21-f6a9eb2999d0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:22.765280 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1ef6fe4e-3d52-4545-bc21-f6a9eb2999d0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:22.770420 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:30:22.778682 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1ef6fe4e-3d52-4545-bc21-f6a9eb2999d0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:22.781086 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1ef6fe4e-3d52-4545-bc21-f6a9eb2999d0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:22.782231 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1ef6fe4e-3d52-4545-bc21-f6a9eb2999d0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1745 microversion: 2.20 time: 0.172875 Aug 05 10:30:22.782780 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 300/597] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:22 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:23.442479 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-a447e71d-dbca-495a-8c31-7ec18e826944 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:23.443703 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-a447e71d-dbca-495a-8c31-7ec18e826944 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:23.450185 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a447e71d-dbca-495a-8c31-7ec18e826944 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:23.450714 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a447e71d-dbca-495a-8c31-7ec18e826944 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:23.451814 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a447e71d-dbca-495a-8c31-7ec18e826944 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:23.451943 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a447e71d-dbca-495a-8c31-7ec18e826944 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:23.454160 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a447e71d-dbca-495a-8c31-7ec18e826944 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:23.454160 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a447e71d-dbca-495a-8c31-7ec18e826944 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:23.605955 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a447e71d-dbca-495a-8c31-7ec18e826944 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:23.610958 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:30:23.618271 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-a447e71d-dbca-495a-8c31-7ec18e826944 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 200 len: 1368 microversion: 2.1 time: 0.179407 Aug 05 10:30:23.618969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 298/598] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:23 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:23.809167 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-423f1666-e79e-442d-bc7e-ba5f604e0dc8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:23.810082 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-423f1666-e79e-442d-bc7e-ba5f604e0dc8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:23.820512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-423f1666-e79e-442d-bc7e-ba5f604e0dc8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:23.821251 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-423f1666-e79e-442d-bc7e-ba5f604e0dc8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:23.821968 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-423f1666-e79e-442d-bc7e-ba5f604e0dc8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:23.823103 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-423f1666-e79e-442d-bc7e-ba5f604e0dc8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:23.823805 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-423f1666-e79e-442d-bc7e-ba5f604e0dc8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:23.824482 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-423f1666-e79e-442d-bc7e-ba5f604e0dc8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:23.962012 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-423f1666-e79e-442d-bc7e-ba5f604e0dc8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:23.970812 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-423f1666-e79e-442d-bc7e-ba5f604e0dc8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:23.972209 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-423f1666-e79e-442d-bc7e-ba5f604e0dc8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:23.973795 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-423f1666-e79e-442d-bc7e-ba5f604e0dc8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1745 microversion: 2.20 time: 0.170950 Aug 05 10:30:23.974465 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 301/599] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:23 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:24.640983 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-081daf35-a615-4a91-aa90-eb07f717f528 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:24.641668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-081daf35-a615-4a91-aa90-eb07f717f528 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:24.652240 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-081daf35-a615-4a91-aa90-eb07f717f528 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:24.652826 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-081daf35-a615-4a91-aa90-eb07f717f528 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:24.653339 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-081daf35-a615-4a91-aa90-eb07f717f528 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:24.654112 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-081daf35-a615-4a91-aa90-eb07f717f528 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:24.654564 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-081daf35-a615-4a91-aa90-eb07f717f528 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:24.655169 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-081daf35-a615-4a91-aa90-eb07f717f528 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:24.850632 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-081daf35-a615-4a91-aa90-eb07f717f528 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:24.860861 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-081daf35-a615-4a91-aa90-eb07f717f528 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 200 len: 1368 microversion: 2.1 time: 0.224458 Aug 05 10:30:24.861488 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 299/600] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:24 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:24.997870 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-31489f25-7bed-448c-a650-9c8ad16c6b19 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:24.998440 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-31489f25-7bed-448c-a650-9c8ad16c6b19 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:25.005731 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31489f25-7bed-448c-a650-9c8ad16c6b19 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:25.006203 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31489f25-7bed-448c-a650-9c8ad16c6b19 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:25.006633 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31489f25-7bed-448c-a650-9c8ad16c6b19 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:25.007346 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31489f25-7bed-448c-a650-9c8ad16c6b19 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:25.007792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31489f25-7bed-448c-a650-9c8ad16c6b19 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:25.008205 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31489f25-7bed-448c-a650-9c8ad16c6b19 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:25.141688 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-31489f25-7bed-448c-a650-9c8ad16c6b19 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:25.150205 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-31489f25-7bed-448c-a650-9c8ad16c6b19 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:25.151747 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-31489f25-7bed-448c-a650-9c8ad16c6b19 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:25.152917 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-31489f25-7bed-448c-a650-9c8ad16c6b19 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1745 microversion: 2.20 time: 0.159026 Aug 05 10:30:25.153505 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 302/601] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:24 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:25.687718 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-4432eabb-dc09-4eab-880a-62daab5a70a0 req-32ea6882-9877-4190-9351-6e8fcb24a81a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7c11c7-dddb-481d-9d57-af021c48e71b", "name": "network-vif-plugged", "status": "completed", "tag": "9e68983d-a83c-49ba-ac19-3c316e21a882"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:30:25.700147 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-4432eabb-dc09-4eab-880a-62daab5a70a0 req-32ea6882-9877-4190-9351-6e8fcb24a81a service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:25.700704 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-4432eabb-dc09-4eab-880a-62daab5a70a0 req-32ea6882-9877-4190-9351-6e8fcb24a81a service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:25.701433 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-4432eabb-dc09-4eab-880a-62daab5a70a0 req-32ea6882-9877-4190-9351-6e8fcb24a81a service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:25.715392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-4432eabb-dc09-4eab-880a-62daab5a70a0 req-32ea6882-9877-4190-9351-6e8fcb24a81a service nova] Creating event network-vif-plugged:9e68983d-a83c-49ba-ac19-3c316e21a882 for instance af7c11c7-dddb-481d-9d57-af021c48e71b on hv-cinder-81558 Aug 05 10:30:25.720807 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-4432eabb-dc09-4eab-880a-62daab5a70a0 req-32ea6882-9877-4190-9351-6e8fcb24a81a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036720 Aug 05 10:30:25.721567 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 300/602] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:30:25.889956 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-79413dc6-b693-4db6-ba95-f1b419198e7c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:25.890737 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-79413dc6-b693-4db6-ba95-f1b419198e7c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:25.897615 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-79413dc6-b693-4db6-ba95-f1b419198e7c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:25.898095 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-79413dc6-b693-4db6-ba95-f1b419198e7c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:25.898524 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-79413dc6-b693-4db6-ba95-f1b419198e7c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:25.899305 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-79413dc6-b693-4db6-ba95-f1b419198e7c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:25.899725 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-79413dc6-b693-4db6-ba95-f1b419198e7c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:25.900145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-79413dc6-b693-4db6-ba95-f1b419198e7c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:26.046682 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-79413dc6-b693-4db6-ba95-f1b419198e7c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:26.056273 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-79413dc6-b693-4db6-ba95-f1b419198e7c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 200 len: 1368 microversion: 2.1 time: 0.170540 Aug 05 10:30:26.056893 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 303/603] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:25 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:26.178946 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-9093bfa2-3364-4768-9790-c9b560d15615 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:26.179708 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-9093bfa2-3364-4768-9790-c9b560d15615 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:26.186633 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9093bfa2-3364-4768-9790-c9b560d15615 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:26.187220 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9093bfa2-3364-4768-9790-c9b560d15615 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:26.187682 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9093bfa2-3364-4768-9790-c9b560d15615 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:26.188428 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9093bfa2-3364-4768-9790-c9b560d15615 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:26.188867 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9093bfa2-3364-4768-9790-c9b560d15615 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:26.189580 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9093bfa2-3364-4768-9790-c9b560d15615 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:26.339922 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-9093bfa2-3364-4768-9790-c9b560d15615 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:26.349531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-9093bfa2-3364-4768-9790-c9b560d15615 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:26.352936 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-9093bfa2-3364-4768-9790-c9b560d15615 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:26.354177 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-9093bfa2-3364-4768-9790-c9b560d15615 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1745 microversion: 2.20 time: 0.180901 Aug 05 10:30:26.354763 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 301/604] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:26 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1745 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:27.077092 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ce5c1e54-7527-4f83-936c-9d003a51f373 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:27.077690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ce5c1e54-7527-4f83-936c-9d003a51f373 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:27.084427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce5c1e54-7527-4f83-936c-9d003a51f373 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:27.084904 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce5c1e54-7527-4f83-936c-9d003a51f373 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:27.085759 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce5c1e54-7527-4f83-936c-9d003a51f373 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:27.086469 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce5c1e54-7527-4f83-936c-9d003a51f373 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:27.087253 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce5c1e54-7527-4f83-936c-9d003a51f373 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:27.087786 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce5c1e54-7527-4f83-936c-9d003a51f373 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:27.229010 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ce5c1e54-7527-4f83-936c-9d003a51f373 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:27.237478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ce5c1e54-7527-4f83-936c-9d003a51f373 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 200 len: 1558 microversion: 2.1 time: 0.164179 Aug 05 10:30:27.238062 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 304/605] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:27 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:27.258302 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-e150be7f-d34c-4b50-babe-02329381a86d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:27.258996 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-e150be7f-d34c-4b50-babe-02329381a86d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:27.266195 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e150be7f-d34c-4b50-babe-02329381a86d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:27.266844 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e150be7f-d34c-4b50-babe-02329381a86d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:27.267414 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e150be7f-d34c-4b50-babe-02329381a86d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:27.268400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e150be7f-d34c-4b50-babe-02329381a86d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:27.269029 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e150be7f-d34c-4b50-babe-02329381a86d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:27.269638 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e150be7f-d34c-4b50-babe-02329381a86d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:27.353202 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-e150be7f-d34c-4b50-babe-02329381a86d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098946 Aug 05 10:30:27.353795 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 302/606] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 5 10:30:27 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:30:27.376224 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-47249ce8-8f1d-47dd-97a1-48bd7e831514 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:27.377559 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-47249ce8-8f1d-47dd-97a1-48bd7e831514 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:27.384484 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47249ce8-8f1d-47dd-97a1-48bd7e831514 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:27.385095 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47249ce8-8f1d-47dd-97a1-48bd7e831514 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:27.385590 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47249ce8-8f1d-47dd-97a1-48bd7e831514 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:27.386350 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47249ce8-8f1d-47dd-97a1-48bd7e831514 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:27.386979 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47249ce8-8f1d-47dd-97a1-48bd7e831514 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:27.387380 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47249ce8-8f1d-47dd-97a1-48bd7e831514 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:27.541900 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-47249ce8-8f1d-47dd-97a1-48bd7e831514 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:27.552180 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-47249ce8-8f1d-47dd-97a1-48bd7e831514 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:27.554552 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-47249ce8-8f1d-47dd-97a1-48bd7e831514 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:27.556037 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-47249ce8-8f1d-47dd-97a1-48bd7e831514 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1740 microversion: 2.20 time: 0.183893 Aug 05 10:30:27.557099 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 305/607] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:27 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:28.582151 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-1e650bc3-ec28-4131-b4c8-43420c116e08 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:28.583566 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-1e650bc3-ec28-4131-b4c8-43420c116e08 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:28.592487 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1e650bc3-ec28-4131-b4c8-43420c116e08 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:28.596491 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1e650bc3-ec28-4131-b4c8-43420c116e08 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:28.597299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1e650bc3-ec28-4131-b4c8-43420c116e08 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:28.598946 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1e650bc3-ec28-4131-b4c8-43420c116e08 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:28.599638 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1e650bc3-ec28-4131-b4c8-43420c116e08 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:28.600502 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1e650bc3-ec28-4131-b4c8-43420c116e08 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:28.929868 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-1e650bc3-ec28-4131-b4c8-43420c116e08 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:28.948135 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-1e650bc3-ec28-4131-b4c8-43420c116e08 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:28.950213 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-227ae3a3-8fe0-48fd-baeb-3709511ec86e req-68c377db-06bb-4ddb-b14c-ea09c39b7e43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3", "tag": "fe9efa99-2628-4877-9bb9-0064315a40ca"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:30:28.956048 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-1e650bc3-ec28-4131-b4c8-43420c116e08 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:28.957772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-1e650bc3-ec28-4131-b4c8-43420c116e08 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1740 microversion: 2.20 time: 0.380817 Aug 05 10:30:28.958632 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 303/608] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:28 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1740 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:28.966098 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-227ae3a3-8fe0-48fd-baeb-3709511ec86e req-68c377db-06bb-4ddb-b14c-ea09c39b7e43 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:28.966578 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-227ae3a3-8fe0-48fd-baeb-3709511ec86e req-68c377db-06bb-4ddb-b14c-ea09c39b7e43 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:28.967016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-227ae3a3-8fe0-48fd-baeb-3709511ec86e req-68c377db-06bb-4ddb-b14c-ea09c39b7e43 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:28.980616 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-227ae3a3-8fe0-48fd-baeb-3709511ec86e req-68c377db-06bb-4ddb-b14c-ea09c39b7e43 service nova] Creating event network-changed:fe9efa99-2628-4877-9bb9-0064315a40ca for instance 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 on hv-cinder-81558 Aug 05 10:30:28.986286 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-227ae3a3-8fe0-48fd-baeb-3709511ec86e req-68c377db-06bb-4ddb-b14c-ea09c39b7e43 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039558 Aug 05 10:30:28.987643 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 306/609] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:30:29.984592 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-e3bac8c9-4e72-4d65-a303-0179a7d6137f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:29.985150 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-e3bac8c9-4e72-4d65-a303-0179a7d6137f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:29.998244 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e3bac8c9-4e72-4d65-a303-0179a7d6137f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:30.000464 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e3bac8c9-4e72-4d65-a303-0179a7d6137f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:30.001166 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e3bac8c9-4e72-4d65-a303-0179a7d6137f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:30.002691 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e3bac8c9-4e72-4d65-a303-0179a7d6137f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:30.005620 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e3bac8c9-4e72-4d65-a303-0179a7d6137f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:30.006175 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e3bac8c9-4e72-4d65-a303-0179a7d6137f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:30.220859 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e3bac8c9-4e72-4d65-a303-0179a7d6137f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:30.230868 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e3bac8c9-4e72-4d65-a303-0179a7d6137f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:30.232416 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e3bac8c9-4e72-4d65-a303-0179a7d6137f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:30.233813 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-e3bac8c9-4e72-4d65-a303-0179a7d6137f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1740 microversion: 2.20 time: 0.253837 Aug 05 10:30:30.234546 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 304/610] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:29 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1740 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:31.258003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2b1ae8e0-ec9e-415c-a4fd-445300504a52 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:31.258685 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2b1ae8e0-ec9e-415c-a4fd-445300504a52 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:31.265252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b1ae8e0-ec9e-415c-a4fd-445300504a52 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:31.265737 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b1ae8e0-ec9e-415c-a4fd-445300504a52 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:31.266347 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b1ae8e0-ec9e-415c-a4fd-445300504a52 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:31.267285 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b1ae8e0-ec9e-415c-a4fd-445300504a52 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:31.267917 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b1ae8e0-ec9e-415c-a4fd-445300504a52 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:31.268955 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b1ae8e0-ec9e-415c-a4fd-445300504a52 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:31.415979 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2b1ae8e0-ec9e-415c-a4fd-445300504a52 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:31.425432 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2b1ae8e0-ec9e-415c-a4fd-445300504a52 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:31.428200 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2b1ae8e0-ec9e-415c-a4fd-445300504a52 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:31.429748 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2b1ae8e0-ec9e-415c-a4fd-445300504a52 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1740 microversion: 2.20 time: 0.176402 Aug 05 10:30:31.443056 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 307/611] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:31 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:32.455653 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-4d7cea38-ed25-466d-8c66-ce09b8255312 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:32.456878 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-4d7cea38-ed25-466d-8c66-ce09b8255312 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:32.463888 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4d7cea38-ed25-466d-8c66-ce09b8255312 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:32.464370 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4d7cea38-ed25-466d-8c66-ce09b8255312 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:32.464982 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4d7cea38-ed25-466d-8c66-ce09b8255312 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:32.465667 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4d7cea38-ed25-466d-8c66-ce09b8255312 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:32.466221 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4d7cea38-ed25-466d-8c66-ce09b8255312 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:32.466561 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4d7cea38-ed25-466d-8c66-ce09b8255312 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:32.620883 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-4d7cea38-ed25-466d-8c66-ce09b8255312 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:32.630211 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-4d7cea38-ed25-466d-8c66-ce09b8255312 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:32.632181 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-4d7cea38-ed25-466d-8c66-ce09b8255312 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:32.633504 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-4d7cea38-ed25-466d-8c66-ce09b8255312 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1740 microversion: 2.20 time: 0.182282 Aug 05 10:30:32.634071 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 305/612] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:32 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:33.657342 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a8b8cc53-7913-4736-bdcb-8d4aa1b087b0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:33.658837 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a8b8cc53-7913-4736-bdcb-8d4aa1b087b0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:33.666425 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8b8cc53-7913-4736-bdcb-8d4aa1b087b0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:33.667052 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8b8cc53-7913-4736-bdcb-8d4aa1b087b0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:33.674340 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8b8cc53-7913-4736-bdcb-8d4aa1b087b0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:33.674340 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8b8cc53-7913-4736-bdcb-8d4aa1b087b0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:33.674340 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8b8cc53-7913-4736-bdcb-8d4aa1b087b0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:33.674340 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8b8cc53-7913-4736-bdcb-8d4aa1b087b0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:33.822815 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a8b8cc53-7913-4736-bdcb-8d4aa1b087b0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:33.832146 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a8b8cc53-7913-4736-bdcb-8d4aa1b087b0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:33.833651 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a8b8cc53-7913-4736-bdcb-8d4aa1b087b0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:33.834830 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a8b8cc53-7913-4736-bdcb-8d4aa1b087b0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1740 microversion: 2.20 time: 0.182048 Aug 05 10:30:33.835609 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 308/613] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:33 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:34.859408 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-df05295e-eab3-4035-bd48-84523ac48133 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:34.860178 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-df05295e-eab3-4035-bd48-84523ac48133 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:34.867807 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-df05295e-eab3-4035-bd48-84523ac48133 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:34.868291 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-df05295e-eab3-4035-bd48-84523ac48133 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:34.868718 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-df05295e-eab3-4035-bd48-84523ac48133 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:34.869412 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-df05295e-eab3-4035-bd48-84523ac48133 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:34.869905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-df05295e-eab3-4035-bd48-84523ac48133 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:34.870286 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-df05295e-eab3-4035-bd48-84523ac48133 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:35.015478 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-df05295e-eab3-4035-bd48-84523ac48133 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:35.028317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-df05295e-eab3-4035-bd48-84523ac48133 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:35.029848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-df05295e-eab3-4035-bd48-84523ac48133 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:35.031418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-df05295e-eab3-4035-bd48-84523ac48133 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1740 microversion: 2.20 time: 0.176266 Aug 05 10:30:35.031980 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 306/614] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:34 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:36.056311 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dcc18fc3-dad3-4add-bd62-2df0f427381d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:36.056922 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dcc18fc3-dad3-4add-bd62-2df0f427381d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:36.069742 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dcc18fc3-dad3-4add-bd62-2df0f427381d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:36.070221 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dcc18fc3-dad3-4add-bd62-2df0f427381d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:36.070652 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dcc18fc3-dad3-4add-bd62-2df0f427381d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:36.071484 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dcc18fc3-dad3-4add-bd62-2df0f427381d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:36.071919 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dcc18fc3-dad3-4add-bd62-2df0f427381d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:36.072873 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dcc18fc3-dad3-4add-bd62-2df0f427381d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:36.246940 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dcc18fc3-dad3-4add-bd62-2df0f427381d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:36.254828 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dcc18fc3-dad3-4add-bd62-2df0f427381d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:36.256893 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dcc18fc3-dad3-4add-bd62-2df0f427381d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:36.258137 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dcc18fc3-dad3-4add-bd62-2df0f427381d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1740 microversion: 2.20 time: 0.207741 Aug 05 10:30:36.259243 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 309/615] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:36 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:37.304142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b2c37794-dc28-4715-aa88-1fbf3f694ac3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:37.304662 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b2c37794-dc28-4715-aa88-1fbf3f694ac3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:37.307117 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=65 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:30:37.312891 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b2c37794-dc28-4715-aa88-1fbf3f694ac3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:37.313374 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b2c37794-dc28-4715-aa88-1fbf3f694ac3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:37.313966 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b2c37794-dc28-4715-aa88-1fbf3f694ac3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:37.314675 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b2c37794-dc28-4715-aa88-1fbf3f694ac3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:37.315162 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b2c37794-dc28-4715-aa88-1fbf3f694ac3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:37.315587 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b2c37794-dc28-4715-aa88-1fbf3f694ac3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:37.453975 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b2c37794-dc28-4715-aa88-1fbf3f694ac3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:37.462936 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b2c37794-dc28-4715-aa88-1fbf3f694ac3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:37.464438 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b2c37794-dc28-4715-aa88-1fbf3f694ac3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:37.465590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b2c37794-dc28-4715-aa88-1fbf3f694ac3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1740 microversion: 2.20 time: 0.165509 Aug 05 10:30:37.466140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 307/616] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:37 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:38.489900 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bfaaf23c-b4e3-4765-a287-69fab67b4871 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:38.490592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bfaaf23c-b4e3-4765-a287-69fab67b4871 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:38.497634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfaaf23c-b4e3-4765-a287-69fab67b4871 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:38.498117 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfaaf23c-b4e3-4765-a287-69fab67b4871 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:38.498546 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfaaf23c-b4e3-4765-a287-69fab67b4871 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:38.499272 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfaaf23c-b4e3-4765-a287-69fab67b4871 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:38.499723 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfaaf23c-b4e3-4765-a287-69fab67b4871 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:38.500141 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfaaf23c-b4e3-4765-a287-69fab67b4871 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:38.650710 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bfaaf23c-b4e3-4765-a287-69fab67b4871 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:38.659519 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bfaaf23c-b4e3-4765-a287-69fab67b4871 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:38.661043 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bfaaf23c-b4e3-4765-a287-69fab67b4871 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:38.662203 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bfaaf23c-b4e3-4765-a287-69fab67b4871 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1722 microversion: 2.20 time: 0.176493 Aug 05 10:30:38.674867 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 310/617] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:38 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:39.686013 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-39072b37-e83c-4553-814d-21516f6d6c6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:39.686539 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-39072b37-e83c-4553-814d-21516f6d6c6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:39.693574 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-39072b37-e83c-4553-814d-21516f6d6c6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:39.694057 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-39072b37-e83c-4553-814d-21516f6d6c6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:39.694495 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-39072b37-e83c-4553-814d-21516f6d6c6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:39.695250 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-39072b37-e83c-4553-814d-21516f6d6c6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:39.695698 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-39072b37-e83c-4553-814d-21516f6d6c6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:39.696123 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-39072b37-e83c-4553-814d-21516f6d6c6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:39.834970 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-39072b37-e83c-4553-814d-21516f6d6c6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:39.843330 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-39072b37-e83c-4553-814d-21516f6d6c6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:39.844824 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-39072b37-e83c-4553-814d-21516f6d6c6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:39.845974 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-39072b37-e83c-4553-814d-21516f6d6c6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1722 microversion: 2.20 time: 0.164086 Aug 05 10:30:39.846653 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 308/618] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:39 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:40.870316 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2bc9b780-b240-468e-867c-ab4da3527736 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:40.870869 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2bc9b780-b240-468e-867c-ab4da3527736 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:40.874116 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=52 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:30:40.879711 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2bc9b780-b240-468e-867c-ab4da3527736 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:40.880211 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2bc9b780-b240-468e-867c-ab4da3527736 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:40.880623 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2bc9b780-b240-468e-867c-ab4da3527736 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:40.881307 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2bc9b780-b240-468e-867c-ab4da3527736 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:40.881747 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2bc9b780-b240-468e-867c-ab4da3527736 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:40.882158 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2bc9b780-b240-468e-867c-ab4da3527736 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:41.018775 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2bc9b780-b240-468e-867c-ab4da3527736 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:41.028297 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2bc9b780-b240-468e-867c-ab4da3527736 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:41.029779 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2bc9b780-b240-468e-867c-ab4da3527736 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:41.031300 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2bc9b780-b240-468e-867c-ab4da3527736 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1725 microversion: 2.20 time: 0.165991 Aug 05 10:30:41.032095 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 311/619] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:40 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:41.054290 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c9521b8e-3d4d-42c2-b0ce-1ff6deba3e3c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9765be7-4d9f-4cc1-a504-306e579b20a9"}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:30:41.056781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c9521b8e-3d4d-42c2-b0ce-1ff6deba3e3c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:41.063385 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c9521b8e-3d4d-42c2-b0ce-1ff6deba3e3c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:41.064852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c9521b8e-3d4d-42c2-b0ce-1ff6deba3e3c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:41.065328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c9521b8e-3d4d-42c2-b0ce-1ff6deba3e3c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:41.066655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c9521b8e-3d4d-42c2-b0ce-1ff6deba3e3c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:41.067184 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c9521b8e-3d4d-42c2-b0ce-1ff6deba3e3c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:41.067623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c9521b8e-3d4d-42c2-b0ce-1ff6deba3e3c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:41.399065 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c9521b8e-3d4d-42c2-b0ce-1ff6deba3e3c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "POST /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.348586 Aug 05 10:30:41.399631 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 309/620] 10.222.0.40 () {62 vars in 1364 bytes} [Fri Aug 5 10:30:41 2022] POST /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b/os-volume_attachments => generated 188 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 10:30:41.526232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0fbdbec6-bd6c-487c-8cc7-f299de1b14e8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:30:41.526845 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0fbdbec6-bd6c-487c-8cc7-f299de1b14e8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:41.533769 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fbdbec6-bd6c-487c-8cc7-f299de1b14e8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:41.534252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fbdbec6-bd6c-487c-8cc7-f299de1b14e8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:41.534753 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fbdbec6-bd6c-487c-8cc7-f299de1b14e8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:41.535489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fbdbec6-bd6c-487c-8cc7-f299de1b14e8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:41.535952 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fbdbec6-bd6c-487c-8cc7-f299de1b14e8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:41.536401 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0fbdbec6-bd6c-487c-8cc7-f299de1b14e8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:41.584348 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0fbdbec6-bd6c-487c-8cc7-f299de1b14e8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117832) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 10:30:41.677614 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0fbdbec6-bd6c-487c-8cc7-f299de1b14e8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "POST /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b/action" status: 202 len: 0 microversion: 2.20 time: 0.154834 Aug 05 10:30:41.678960 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 312/621] 10.222.0.40 () {62 vars in 1319 bytes} [Fri Aug 5 10:30:41 2022] POST /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:30:41.687810 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-16ad2203-aef0-4204-bb23-cf6d07ef1926 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:41.688613 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-16ad2203-aef0-4204-bb23-cf6d07ef1926 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:41.700376 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-16ad2203-aef0-4204-bb23-cf6d07ef1926 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:41.700941 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-16ad2203-aef0-4204-bb23-cf6d07ef1926 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:41.701445 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-16ad2203-aef0-4204-bb23-cf6d07ef1926 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:41.702249 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-16ad2203-aef0-4204-bb23-cf6d07ef1926 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:41.702780 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-16ad2203-aef0-4204-bb23-cf6d07ef1926 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:41.704171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-16ad2203-aef0-4204-bb23-cf6d07ef1926 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:41.711478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-4d0bf21c-304e-4f29-9097-ecb1f1b0fe9c req-53017c7e-5a70-4820-ba25-d9d932bb7f08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7c11c7-dddb-481d-9d57-af021c48e71b", "name": "network-vif-unplugged", "status": "completed", "tag": "9e68983d-a83c-49ba-ac19-3c316e21a882"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:30:41.725188 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-4d0bf21c-304e-4f29-9097-ecb1f1b0fe9c req-53017c7e-5a70-4820-ba25-d9d932bb7f08 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:41.725727 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-4d0bf21c-304e-4f29-9097-ecb1f1b0fe9c req-53017c7e-5a70-4820-ba25-d9d932bb7f08 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:41.726187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-4d0bf21c-304e-4f29-9097-ecb1f1b0fe9c req-53017c7e-5a70-4820-ba25-d9d932bb7f08 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:41.745611 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.compute.server_external_events [req-4d0bf21c-304e-4f29-9097-ecb1f1b0fe9c req-53017c7e-5a70-4820-ba25-d9d932bb7f08 service nova] Unable to find a host for instance af7c11c7-dddb-481d-9d57-af021c48e71b. Dropping event network-vif-unplugged {{(pid=117832) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 05 10:30:41.746501 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-4d0bf21c-304e-4f29-9097-ecb1f1b0fe9c req-53017c7e-5a70-4820-ba25-d9d932bb7f08 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039828 Aug 05 10:30:41.747572 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 313/622] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 05 10:30:41.875488 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-16ad2203-aef0-4204-bb23-cf6d07ef1926 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:41.886631 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-16ad2203-aef0-4204-bb23-cf6d07ef1926 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:41.888170 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-16ad2203-aef0-4204-bb23-cf6d07ef1926 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:41.889336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-16ad2203-aef0-4204-bb23-cf6d07ef1926 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1751 microversion: 2.20 time: 0.206390 Aug 05 10:30:41.889897 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 310/623] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:41 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1751 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:42.912885 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-572ee191-89a2-461a-9740-f6f6174283ad tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:42.914340 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-572ee191-89a2-461a-9740-f6f6174283ad tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:42.921411 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-572ee191-89a2-461a-9740-f6f6174283ad tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:42.921931 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-572ee191-89a2-461a-9740-f6f6174283ad tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:42.922435 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-572ee191-89a2-461a-9740-f6f6174283ad tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:42.923427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-572ee191-89a2-461a-9740-f6f6174283ad tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:42.923876 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-572ee191-89a2-461a-9740-f6f6174283ad tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:42.924293 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-572ee191-89a2-461a-9740-f6f6174283ad tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:43.081704 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-572ee191-89a2-461a-9740-f6f6174283ad tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:43.090476 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-572ee191-89a2-461a-9740-f6f6174283ad tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:43.091987 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-572ee191-89a2-461a-9740-f6f6174283ad tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:43.093130 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-572ee191-89a2-461a-9740-f6f6174283ad tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1753 microversion: 2.20 time: 0.184359 Aug 05 10:30:43.093672 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 314/624] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:42 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:44.116470 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-85e28d24-e91d-437d-aa68-5a644e81d117 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:44.117154 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-85e28d24-e91d-437d-aa68-5a644e81d117 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:44.123236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-85e28d24-e91d-437d-aa68-5a644e81d117 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:44.123744 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-85e28d24-e91d-437d-aa68-5a644e81d117 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:44.124156 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-85e28d24-e91d-437d-aa68-5a644e81d117 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:44.124845 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-85e28d24-e91d-437d-aa68-5a644e81d117 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:44.125286 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-85e28d24-e91d-437d-aa68-5a644e81d117 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:44.125697 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-85e28d24-e91d-437d-aa68-5a644e81d117 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:44.269028 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-85e28d24-e91d-437d-aa68-5a644e81d117 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:44.277706 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-85e28d24-e91d-437d-aa68-5a644e81d117 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:44.279213 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-85e28d24-e91d-437d-aa68-5a644e81d117 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:44.280724 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-85e28d24-e91d-437d-aa68-5a644e81d117 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.168789 Aug 05 10:30:44.281284 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 311/625] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:44 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:45.303866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-868ce2b5-ae5d-4a80-b3c5-560f7c774149 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:45.304485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-868ce2b5-ae5d-4a80-b3c5-560f7c774149 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:45.311559 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-868ce2b5-ae5d-4a80-b3c5-560f7c774149 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:45.312037 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-868ce2b5-ae5d-4a80-b3c5-560f7c774149 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:45.312473 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-868ce2b5-ae5d-4a80-b3c5-560f7c774149 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:45.313462 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-868ce2b5-ae5d-4a80-b3c5-560f7c774149 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:45.313922 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-868ce2b5-ae5d-4a80-b3c5-560f7c774149 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:45.314343 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-868ce2b5-ae5d-4a80-b3c5-560f7c774149 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:45.447107 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-868ce2b5-ae5d-4a80-b3c5-560f7c774149 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:45.456096 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-868ce2b5-ae5d-4a80-b3c5-560f7c774149 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:45.458090 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-868ce2b5-ae5d-4a80-b3c5-560f7c774149 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:45.459272 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-868ce2b5-ae5d-4a80-b3c5-560f7c774149 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.159432 Aug 05 10:30:45.459784 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 315/626] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:45 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:46.485771 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-0cfee6a9-ea6c-434f-881d-61eaa50cbe0a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:46.486388 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-0cfee6a9-ea6c-434f-881d-61eaa50cbe0a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:46.494136 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0cfee6a9-ea6c-434f-881d-61eaa50cbe0a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:46.494615 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0cfee6a9-ea6c-434f-881d-61eaa50cbe0a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:46.495085 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0cfee6a9-ea6c-434f-881d-61eaa50cbe0a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:46.495764 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0cfee6a9-ea6c-434f-881d-61eaa50cbe0a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:46.496211 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0cfee6a9-ea6c-434f-881d-61eaa50cbe0a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:46.496627 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0cfee6a9-ea6c-434f-881d-61eaa50cbe0a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:46.645037 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-0cfee6a9-ea6c-434f-881d-61eaa50cbe0a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:46.654245 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-0cfee6a9-ea6c-434f-881d-61eaa50cbe0a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:46.656403 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-0cfee6a9-ea6c-434f-881d-61eaa50cbe0a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:46.657571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-0cfee6a9-ea6c-434f-881d-61eaa50cbe0a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.178553 Aug 05 10:30:46.669717 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 312/627] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:46 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:47.682258 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-75e5c9f7-c596-404f-a7fe-396d7a285da2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:47.682976 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-75e5c9f7-c596-404f-a7fe-396d7a285da2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:47.689894 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75e5c9f7-c596-404f-a7fe-396d7a285da2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:47.690373 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75e5c9f7-c596-404f-a7fe-396d7a285da2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:47.690801 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75e5c9f7-c596-404f-a7fe-396d7a285da2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:47.691528 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75e5c9f7-c596-404f-a7fe-396d7a285da2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:47.692012 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75e5c9f7-c596-404f-a7fe-396d7a285da2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:47.692670 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75e5c9f7-c596-404f-a7fe-396d7a285da2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:47.833947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-75e5c9f7-c596-404f-a7fe-396d7a285da2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:47.843320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-75e5c9f7-c596-404f-a7fe-396d7a285da2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:47.844843 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-75e5c9f7-c596-404f-a7fe-396d7a285da2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:47.845990 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-75e5c9f7-c596-404f-a7fe-396d7a285da2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.167884 Aug 05 10:30:47.846739 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 316/628] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:47 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:48.869422 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d58f59e5-12ac-4653-a86f-0d2f6539c9e5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:48.869990 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d58f59e5-12ac-4653-a86f-0d2f6539c9e5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:48.876884 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d58f59e5-12ac-4653-a86f-0d2f6539c9e5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:48.877368 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d58f59e5-12ac-4653-a86f-0d2f6539c9e5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:48.877803 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d58f59e5-12ac-4653-a86f-0d2f6539c9e5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:48.878487 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d58f59e5-12ac-4653-a86f-0d2f6539c9e5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:48.878936 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d58f59e5-12ac-4653-a86f-0d2f6539c9e5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:48.879412 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d58f59e5-12ac-4653-a86f-0d2f6539c9e5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:49.025946 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d58f59e5-12ac-4653-a86f-0d2f6539c9e5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:49.029385 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:30:49.035189 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d58f59e5-12ac-4653-a86f-0d2f6539c9e5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:49.037813 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d58f59e5-12ac-4653-a86f-0d2f6539c9e5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:49.038994 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d58f59e5-12ac-4653-a86f-0d2f6539c9e5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.173643 Aug 05 10:30:49.039562 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 313/629] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:48 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:50.066644 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ca1ce672-69cb-440b-894f-48bc6a1a0389 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:50.068539 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ca1ce672-69cb-440b-894f-48bc6a1a0389 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:50.078524 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca1ce672-69cb-440b-894f-48bc6a1a0389 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:50.079368 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca1ce672-69cb-440b-894f-48bc6a1a0389 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:50.080085 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca1ce672-69cb-440b-894f-48bc6a1a0389 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:50.081223 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca1ce672-69cb-440b-894f-48bc6a1a0389 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:50.081971 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca1ce672-69cb-440b-894f-48bc6a1a0389 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:50.083031 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca1ce672-69cb-440b-894f-48bc6a1a0389 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:50.221161 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ca1ce672-69cb-440b-894f-48bc6a1a0389 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:50.224916 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:30:50.230623 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ca1ce672-69cb-440b-894f-48bc6a1a0389 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:50.232184 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ca1ce672-69cb-440b-894f-48bc6a1a0389 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:50.233338 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ca1ce672-69cb-440b-894f-48bc6a1a0389 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.173390 Aug 05 10:30:50.233885 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 317/630] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:50 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:51.260426 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d7f5266d-528e-45e6-a8a8-89e3be131401 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:51.261145 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d7f5266d-528e-45e6-a8a8-89e3be131401 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:51.268969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d7f5266d-528e-45e6-a8a8-89e3be131401 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:51.269622 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d7f5266d-528e-45e6-a8a8-89e3be131401 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:51.270062 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d7f5266d-528e-45e6-a8a8-89e3be131401 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:51.270790 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d7f5266d-528e-45e6-a8a8-89e3be131401 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:51.271283 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d7f5266d-528e-45e6-a8a8-89e3be131401 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:51.271736 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d7f5266d-528e-45e6-a8a8-89e3be131401 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:51.411210 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d7f5266d-528e-45e6-a8a8-89e3be131401 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:51.424337 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d7f5266d-528e-45e6-a8a8-89e3be131401 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:51.426781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d7f5266d-528e-45e6-a8a8-89e3be131401 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:51.428058 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d7f5266d-528e-45e6-a8a8-89e3be131401 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.174861 Aug 05 10:30:51.428627 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 314/631] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:51 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:52.451675 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1560e007-81c2-4636-a503-ea6f493a9a9f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:52.452328 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1560e007-81c2-4636-a503-ea6f493a9a9f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:52.464030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1560e007-81c2-4636-a503-ea6f493a9a9f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:52.464765 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1560e007-81c2-4636-a503-ea6f493a9a9f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:52.465322 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1560e007-81c2-4636-a503-ea6f493a9a9f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:52.466354 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1560e007-81c2-4636-a503-ea6f493a9a9f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:52.467151 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1560e007-81c2-4636-a503-ea6f493a9a9f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:52.467570 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1560e007-81c2-4636-a503-ea6f493a9a9f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:52.604701 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1560e007-81c2-4636-a503-ea6f493a9a9f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:52.617341 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1560e007-81c2-4636-a503-ea6f493a9a9f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:52.618829 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1560e007-81c2-4636-a503-ea6f493a9a9f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:52.620000 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1560e007-81c2-4636-a503-ea6f493a9a9f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.172482 Aug 05 10:30:52.620558 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 318/632] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:52 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:52.900022 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-fc1340ea-4c39-4dac-8df8-688eecd98d9b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:30:52.903890 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-fc1340ea-4c39-4dac-8df8-688eecd98d9b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:52.914568 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fc1340ea-4c39-4dac-8df8-688eecd98d9b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:52.915085 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fc1340ea-4c39-4dac-8df8-688eecd98d9b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:52.915530 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fc1340ea-4c39-4dac-8df8-688eecd98d9b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:52.916226 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fc1340ea-4c39-4dac-8df8-688eecd98d9b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:52.916701 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fc1340ea-4c39-4dac-8df8-688eecd98d9b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:52.917157 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fc1340ea-4c39-4dac-8df8-688eecd98d9b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:52.996885 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-fc1340ea-4c39-4dac-8df8-688eecd98d9b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "POST /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc/action" status: 202 len: 0 microversion: 2.1 time: 0.103378 Aug 05 10:30:52.997805 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 315/633] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 10:30:52 2022] POST /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:30:53.007719 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cea1d889-a16d-4ce6-a4e0-f74cdd96011e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:53.008261 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cea1d889-a16d-4ce6-a4e0-f74cdd96011e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:53.016223 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cea1d889-a16d-4ce6-a4e0-f74cdd96011e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:53.016809 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cea1d889-a16d-4ce6-a4e0-f74cdd96011e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:53.017260 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cea1d889-a16d-4ce6-a4e0-f74cdd96011e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:53.018003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cea1d889-a16d-4ce6-a4e0-f74cdd96011e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:53.018548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cea1d889-a16d-4ce6-a4e0-f74cdd96011e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:53.018892 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cea1d889-a16d-4ce6-a4e0-f74cdd96011e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:53.179304 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cea1d889-a16d-4ce6-a4e0-f74cdd96011e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:53.189076 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cea1d889-a16d-4ce6-a4e0-f74cdd96011e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1749 microversion: 2.1 time: 0.186546 Aug 05 10:30:53.189630 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 319/634] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:53 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1749 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:53.648011 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-746168cd-6c55-424c-b252-4c19ed3b760e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:53.649172 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-746168cd-6c55-424c-b252-4c19ed3b760e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:53.660468 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-746168cd-6c55-424c-b252-4c19ed3b760e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:53.661261 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-746168cd-6c55-424c-b252-4c19ed3b760e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:53.662025 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-746168cd-6c55-424c-b252-4c19ed3b760e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:53.662942 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-746168cd-6c55-424c-b252-4c19ed3b760e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:53.663425 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-746168cd-6c55-424c-b252-4c19ed3b760e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:53.663820 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-746168cd-6c55-424c-b252-4c19ed3b760e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:54.052355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-746168cd-6c55-424c-b252-4c19ed3b760e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:54.061714 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-746168cd-6c55-424c-b252-4c19ed3b760e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:54.063258 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-746168cd-6c55-424c-b252-4c19ed3b760e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:54.064418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-746168cd-6c55-424c-b252-4c19ed3b760e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.423825 Aug 05 10:30:54.064974 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 316/635] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:53 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:54.212487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-282712a7-d2f3-485b-b481-02b585107100 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:54.213151 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-282712a7-d2f3-485b-b481-02b585107100 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:54.220338 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-282712a7-d2f3-485b-b481-02b585107100 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:54.220819 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-282712a7-d2f3-485b-b481-02b585107100 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:54.221852 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-282712a7-d2f3-485b-b481-02b585107100 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:54.222174 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-282712a7-d2f3-485b-b481-02b585107100 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:54.222347 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-282712a7-d2f3-485b-b481-02b585107100 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:54.223021 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-282712a7-d2f3-485b-b481-02b585107100 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:54.379883 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-282712a7-d2f3-485b-b481-02b585107100 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:54.388447 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-282712a7-d2f3-485b-b481-02b585107100 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1749 microversion: 2.1 time: 0.180607 Aug 05 10:30:54.389015 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 320/636] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:54 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1749 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:55.091290 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-87318ffe-a373-4571-9a2f-fd39da4d80b9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:55.093040 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-87318ffe-a373-4571-9a2f-fd39da4d80b9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:55.103554 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-87318ffe-a373-4571-9a2f-fd39da4d80b9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:55.104394 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-87318ffe-a373-4571-9a2f-fd39da4d80b9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:55.105029 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-87318ffe-a373-4571-9a2f-fd39da4d80b9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:55.105903 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-87318ffe-a373-4571-9a2f-fd39da4d80b9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:55.106533 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-87318ffe-a373-4571-9a2f-fd39da4d80b9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:55.107182 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-87318ffe-a373-4571-9a2f-fd39da4d80b9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:55.249998 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-87318ffe-a373-4571-9a2f-fd39da4d80b9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:55.261702 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-87318ffe-a373-4571-9a2f-fd39da4d80b9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:55.263209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-87318ffe-a373-4571-9a2f-fd39da4d80b9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:55.264368 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-87318ffe-a373-4571-9a2f-fd39da4d80b9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.180207 Aug 05 10:30:55.264967 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 317/637] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:55 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:55.410212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6487eefe-8ed8-48d1-ad32-7079dec415e7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:55.410844 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6487eefe-8ed8-48d1-ad32-7079dec415e7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:55.417767 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6487eefe-8ed8-48d1-ad32-7079dec415e7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:55.418248 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6487eefe-8ed8-48d1-ad32-7079dec415e7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:55.418679 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6487eefe-8ed8-48d1-ad32-7079dec415e7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:55.419405 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6487eefe-8ed8-48d1-ad32-7079dec415e7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:55.419856 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6487eefe-8ed8-48d1-ad32-7079dec415e7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:55.420274 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6487eefe-8ed8-48d1-ad32-7079dec415e7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:55.573938 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6487eefe-8ed8-48d1-ad32-7079dec415e7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:55.582636 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6487eefe-8ed8-48d1-ad32-7079dec415e7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1749 microversion: 2.1 time: 0.176379 Aug 05 10:30:55.583210 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 321/638] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:55 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1749 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:56.291758 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-a685aa3c-3e7a-481d-9034-f92a930cf76e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:56.292731 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-a685aa3c-3e7a-481d-9034-f92a930cf76e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:56.302296 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a685aa3c-3e7a-481d-9034-f92a930cf76e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:56.303207 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a685aa3c-3e7a-481d-9034-f92a930cf76e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:56.303950 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a685aa3c-3e7a-481d-9034-f92a930cf76e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:56.304239 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a685aa3c-3e7a-481d-9034-f92a930cf76e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:56.304691 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a685aa3c-3e7a-481d-9034-f92a930cf76e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:56.305136 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a685aa3c-3e7a-481d-9034-f92a930cf76e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:56.444406 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a685aa3c-3e7a-481d-9034-f92a930cf76e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:56.457523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a685aa3c-3e7a-481d-9034-f92a930cf76e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:56.459717 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a685aa3c-3e7a-481d-9034-f92a930cf76e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:56.460934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-a685aa3c-3e7a-481d-9034-f92a930cf76e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.175437 Aug 05 10:30:56.461483 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 318/639] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:56 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:56.604208 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4ded74dd-8ff6-4923-9b16-96ada155912c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:56.604885 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4ded74dd-8ff6-4923-9b16-96ada155912c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:56.611111 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ded74dd-8ff6-4923-9b16-96ada155912c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:56.611579 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ded74dd-8ff6-4923-9b16-96ada155912c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:56.612008 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ded74dd-8ff6-4923-9b16-96ada155912c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:56.612693 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ded74dd-8ff6-4923-9b16-96ada155912c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:56.613431 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ded74dd-8ff6-4923-9b16-96ada155912c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:56.613849 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ded74dd-8ff6-4923-9b16-96ada155912c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:56.760361 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4ded74dd-8ff6-4923-9b16-96ada155912c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:56.769498 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4ded74dd-8ff6-4923-9b16-96ada155912c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1749 microversion: 2.1 time: 0.169300 Aug 05 10:30:56.770071 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 322/640] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:56 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1749 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:57.483642 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-2cb96f44-2f8a-4963-883b-7f6a6c969287 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:57.484284 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-2cb96f44-2f8a-4963-883b-7f6a6c969287 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:57.491095 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2cb96f44-2f8a-4963-883b-7f6a6c969287 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:57.491575 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2cb96f44-2f8a-4963-883b-7f6a6c969287 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:57.492003 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2cb96f44-2f8a-4963-883b-7f6a6c969287 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:57.492685 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2cb96f44-2f8a-4963-883b-7f6a6c969287 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:57.493130 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2cb96f44-2f8a-4963-883b-7f6a6c969287 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:57.493545 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2cb96f44-2f8a-4963-883b-7f6a6c969287 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:57.635939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2cb96f44-2f8a-4963-883b-7f6a6c969287 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:57.664827 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2cb96f44-2f8a-4963-883b-7f6a6c969287 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:57.666351 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2cb96f44-2f8a-4963-883b-7f6a6c969287 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:57.667635 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-2cb96f44-2f8a-4963-883b-7f6a6c969287 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.187885 Aug 05 10:30:57.668462 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 319/641] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:57 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:57.792151 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b2ecd35a-624d-48f6-8988-69e200a7c72c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:57.792761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b2ecd35a-624d-48f6-8988-69e200a7c72c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:57.799846 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2ecd35a-624d-48f6-8988-69e200a7c72c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:57.800342 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2ecd35a-624d-48f6-8988-69e200a7c72c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:57.800764 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2ecd35a-624d-48f6-8988-69e200a7c72c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:57.801446 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2ecd35a-624d-48f6-8988-69e200a7c72c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:57.801887 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2ecd35a-624d-48f6-8988-69e200a7c72c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:57.802296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2ecd35a-624d-48f6-8988-69e200a7c72c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:57.951335 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b2ecd35a-624d-48f6-8988-69e200a7c72c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:57.960253 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b2ecd35a-624d-48f6-8988-69e200a7c72c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1749 microversion: 2.1 time: 0.172117 Aug 05 10:30:57.960821 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 323/642] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:57 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:58.690937 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-51e76456-8f00-40f5-b13c-079ee1f5e1e3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:58.691595 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-51e76456-8f00-40f5-b13c-079ee1f5e1e3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:58.698047 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-51e76456-8f00-40f5-b13c-079ee1f5e1e3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:58.698515 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-51e76456-8f00-40f5-b13c-079ee1f5e1e3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:58.699032 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-51e76456-8f00-40f5-b13c-079ee1f5e1e3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:58.699708 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-51e76456-8f00-40f5-b13c-079ee1f5e1e3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:58.700177 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-51e76456-8f00-40f5-b13c-079ee1f5e1e3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:58.700594 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-51e76456-8f00-40f5-b13c-079ee1f5e1e3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:58.840333 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-51e76456-8f00-40f5-b13c-079ee1f5e1e3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:58.872429 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-51e76456-8f00-40f5-b13c-079ee1f5e1e3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:58.876303 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-51e76456-8f00-40f5-b13c-079ee1f5e1e3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:58.880008 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-51e76456-8f00-40f5-b13c-079ee1f5e1e3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.192976 Aug 05 10:30:58.880899 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 320/643] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:58 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:30:58.986063 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-95d67d9f-216b-4da8-a98e-49fb9a98bd82 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:58.987276 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-95d67d9f-216b-4da8-a98e-49fb9a98bd82 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:58.998484 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-95d67d9f-216b-4da8-a98e-49fb9a98bd82 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:58.999314 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-95d67d9f-216b-4da8-a98e-49fb9a98bd82 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:59.000020 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-95d67d9f-216b-4da8-a98e-49fb9a98bd82 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:59.001144 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-95d67d9f-216b-4da8-a98e-49fb9a98bd82 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:59.002428 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-95d67d9f-216b-4da8-a98e-49fb9a98bd82 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:59.003170 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-95d67d9f-216b-4da8-a98e-49fb9a98bd82 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:59.167414 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-95d67d9f-216b-4da8-a98e-49fb9a98bd82 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:30:59.175909 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-95d67d9f-216b-4da8-a98e-49fb9a98bd82 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1749 microversion: 2.1 time: 0.196652 Aug 05 10:30:59.176465 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 324/644] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:30:58 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1749 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:30:59.908422 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-2ec1d4b9-007b-491f-b36a-8bdee9d28fa5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:30:59.909506 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-2ec1d4b9-007b-491f-b36a-8bdee9d28fa5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:30:59.917350 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2ec1d4b9-007b-491f-b36a-8bdee9d28fa5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:59.917829 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2ec1d4b9-007b-491f-b36a-8bdee9d28fa5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:59.918261 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2ec1d4b9-007b-491f-b36a-8bdee9d28fa5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:30:59.919009 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2ec1d4b9-007b-491f-b36a-8bdee9d28fa5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:30:59.919441 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2ec1d4b9-007b-491f-b36a-8bdee9d28fa5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:30:59.919846 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2ec1d4b9-007b-491f-b36a-8bdee9d28fa5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:00.070254 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2ec1d4b9-007b-491f-b36a-8bdee9d28fa5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:00.081215 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2ec1d4b9-007b-491f-b36a-8bdee9d28fa5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:00.082708 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2ec1d4b9-007b-491f-b36a-8bdee9d28fa5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:00.084716 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-2ec1d4b9-007b-491f-b36a-8bdee9d28fa5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.182532 Aug 05 10:31:00.085297 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 321/645] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:30:59 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:31:00.198254 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-526dbaff-2218-4d62-90de-351002af4233 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:00.198836 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-526dbaff-2218-4d62-90de-351002af4233 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:00.206069 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-526dbaff-2218-4d62-90de-351002af4233 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:00.206545 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-526dbaff-2218-4d62-90de-351002af4233 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:00.207003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-526dbaff-2218-4d62-90de-351002af4233 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:00.207694 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-526dbaff-2218-4d62-90de-351002af4233 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:00.208106 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-526dbaff-2218-4d62-90de-351002af4233 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:00.208518 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-526dbaff-2218-4d62-90de-351002af4233 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:00.352398 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-526dbaff-2218-4d62-90de-351002af4233 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:00.360739 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-526dbaff-2218-4d62-90de-351002af4233 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1749 microversion: 2.1 time: 0.166455 Aug 05 10:31:00.361312 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 325/646] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:00 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1749 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:01.115967 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-6dcab25d-b480-4885-a94a-be42a2448f41 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:01.117025 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-6dcab25d-b480-4885-a94a-be42a2448f41 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:01.124093 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6dcab25d-b480-4885-a94a-be42a2448f41 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:01.124597 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6dcab25d-b480-4885-a94a-be42a2448f41 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:01.125028 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6dcab25d-b480-4885-a94a-be42a2448f41 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:01.125717 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6dcab25d-b480-4885-a94a-be42a2448f41 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:01.126160 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6dcab25d-b480-4885-a94a-be42a2448f41 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:01.126578 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6dcab25d-b480-4885-a94a-be42a2448f41 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:01.264698 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-6dcab25d-b480-4885-a94a-be42a2448f41 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:01.279087 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-6dcab25d-b480-4885-a94a-be42a2448f41 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:01.281839 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-6dcab25d-b480-4885-a94a-be42a2448f41 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:01.283780 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-6dcab25d-b480-4885-a94a-be42a2448f41 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.171830 Aug 05 10:31:01.285109 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 322/647] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:31:01 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:31:01.385190 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3fab06e6-6f50-4b25-8d79-b15297a17638 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:01.385794 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3fab06e6-6f50-4b25-8d79-b15297a17638 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:01.393926 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3fab06e6-6f50-4b25-8d79-b15297a17638 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:01.394485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3fab06e6-6f50-4b25-8d79-b15297a17638 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:01.395028 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3fab06e6-6f50-4b25-8d79-b15297a17638 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:01.395833 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3fab06e6-6f50-4b25-8d79-b15297a17638 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:01.396330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3fab06e6-6f50-4b25-8d79-b15297a17638 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:01.396844 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3fab06e6-6f50-4b25-8d79-b15297a17638 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:01.557200 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3fab06e6-6f50-4b25-8d79-b15297a17638 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:01.565655 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3fab06e6-6f50-4b25-8d79-b15297a17638 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1749 microversion: 2.1 time: 0.185475 Aug 05 10:31:01.566224 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 326/648] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:01 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1749 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:02.311590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-5c72ae82-c0e1-4896-a342-e889818780ae tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:02.312580 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-5c72ae82-c0e1-4896-a342-e889818780ae tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:02.323744 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5c72ae82-c0e1-4896-a342-e889818780ae tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:02.324629 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5c72ae82-c0e1-4896-a342-e889818780ae tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:02.325342 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5c72ae82-c0e1-4896-a342-e889818780ae tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:02.326523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5c72ae82-c0e1-4896-a342-e889818780ae tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:02.327315 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5c72ae82-c0e1-4896-a342-e889818780ae tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:02.328013 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5c72ae82-c0e1-4896-a342-e889818780ae tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:02.467588 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-5c72ae82-c0e1-4896-a342-e889818780ae tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:02.476705 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-5c72ae82-c0e1-4896-a342-e889818780ae tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:02.478180 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-5c72ae82-c0e1-4896-a342-e889818780ae tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:02.479379 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-5c72ae82-c0e1-4896-a342-e889818780ae tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.174234 Aug 05 10:31:02.479931 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 323/649] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:31:02 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:31:02.593483 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-02d9e26b-5774-4534-a47e-76e6d7b711d7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:02.594267 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-02d9e26b-5774-4534-a47e-76e6d7b711d7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:02.604053 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02d9e26b-5774-4534-a47e-76e6d7b711d7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:02.604731 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02d9e26b-5774-4534-a47e-76e6d7b711d7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:02.605348 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02d9e26b-5774-4534-a47e-76e6d7b711d7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:02.606320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02d9e26b-5774-4534-a47e-76e6d7b711d7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:02.607067 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02d9e26b-5774-4534-a47e-76e6d7b711d7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:02.607601 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02d9e26b-5774-4534-a47e-76e6d7b711d7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:02.777546 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-02d9e26b-5774-4534-a47e-76e6d7b711d7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:02.789034 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-02d9e26b-5774-4534-a47e-76e6d7b711d7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1749 microversion: 2.1 time: 0.201109 Aug 05 10:31:02.789601 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 327/650] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:02 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1749 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:03.507512 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-af498dc2-e335-44bb-ac51-8b9345db0c5a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:03.508134 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-af498dc2-e335-44bb-ac51-8b9345db0c5a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:03.515337 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-af498dc2-e335-44bb-ac51-8b9345db0c5a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:03.515829 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-af498dc2-e335-44bb-ac51-8b9345db0c5a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:03.516263 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-af498dc2-e335-44bb-ac51-8b9345db0c5a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:03.516948 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-af498dc2-e335-44bb-ac51-8b9345db0c5a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:03.517453 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-af498dc2-e335-44bb-ac51-8b9345db0c5a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:03.517907 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-af498dc2-e335-44bb-ac51-8b9345db0c5a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:03.664007 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-af498dc2-e335-44bb-ac51-8b9345db0c5a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:03.673145 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-af498dc2-e335-44bb-ac51-8b9345db0c5a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:03.674637 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-af498dc2-e335-44bb-ac51-8b9345db0c5a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:03.675830 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-af498dc2-e335-44bb-ac51-8b9345db0c5a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.175374 Aug 05 10:31:03.676381 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 324/651] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:31:03 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:31:03.815234 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-41ad2706-6924-453b-b438-8aa34ab482b9 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:03.816075 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-41ad2706-6924-453b-b438-8aa34ab482b9 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:03.827493 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41ad2706-6924-453b-b438-8aa34ab482b9 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:03.828281 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41ad2706-6924-453b-b438-8aa34ab482b9 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:03.828993 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41ad2706-6924-453b-b438-8aa34ab482b9 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:03.830122 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41ad2706-6924-453b-b438-8aa34ab482b9 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:03.830856 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41ad2706-6924-453b-b438-8aa34ab482b9 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:03.831582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41ad2706-6924-453b-b438-8aa34ab482b9 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:03.975713 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-41ad2706-6924-453b-b438-8aa34ab482b9 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:03.984082 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-41ad2706-6924-453b-b438-8aa34ab482b9 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1749 microversion: 2.1 time: 0.175474 Aug 05 10:31:03.984633 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 328/652] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:03 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1749 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:04.698757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-4c8c6b32-55b1-4177-a16c-680361340cc5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:04.699374 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-4c8c6b32-55b1-4177-a16c-680361340cc5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:04.706025 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4c8c6b32-55b1-4177-a16c-680361340cc5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:04.706816 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4c8c6b32-55b1-4177-a16c-680361340cc5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:04.707281 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4c8c6b32-55b1-4177-a16c-680361340cc5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:04.707984 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4c8c6b32-55b1-4177-a16c-680361340cc5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:04.708430 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4c8c6b32-55b1-4177-a16c-680361340cc5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:04.708845 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4c8c6b32-55b1-4177-a16c-680361340cc5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:04.938381 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-4c8c6b32-55b1-4177-a16c-680361340cc5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:04.947922 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-4c8c6b32-55b1-4177-a16c-680361340cc5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:04.949352 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-4c8c6b32-55b1-4177-a16c-680361340cc5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:04.950523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-4c8c6b32-55b1-4177-a16c-680361340cc5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.255893 Aug 05 10:31:04.951148 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 325/653] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:31:04 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:31:05.005580 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-adbec6a5-d9b1-40ee-85f4-65e2a5e5c26d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:05.006197 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-adbec6a5-d9b1-40ee-85f4-65e2a5e5c26d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:05.013702 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-adbec6a5-d9b1-40ee-85f4-65e2a5e5c26d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:05.014176 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-adbec6a5-d9b1-40ee-85f4-65e2a5e5c26d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:05.014599 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-adbec6a5-d9b1-40ee-85f4-65e2a5e5c26d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:05.015291 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-adbec6a5-d9b1-40ee-85f4-65e2a5e5c26d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:05.015759 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-adbec6a5-d9b1-40ee-85f4-65e2a5e5c26d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:05.016175 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-adbec6a5-d9b1-40ee-85f4-65e2a5e5c26d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:05.167894 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-adbec6a5-d9b1-40ee-85f4-65e2a5e5c26d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:05.176997 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-adbec6a5-d9b1-40ee-85f4-65e2a5e5c26d tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1749 microversion: 2.1 time: 0.175312 Aug 05 10:31:05.177678 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 329/654] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:05 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1749 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:05.978381 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-a033260b-a4b9-4287-a9b9-d2d853d76401 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:05.979337 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-a033260b-a4b9-4287-a9b9-d2d853d76401 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:05.992102 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a033260b-a4b9-4287-a9b9-d2d853d76401 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:05.992740 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a033260b-a4b9-4287-a9b9-d2d853d76401 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:05.993448 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a033260b-a4b9-4287-a9b9-d2d853d76401 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:05.994501 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a033260b-a4b9-4287-a9b9-d2d853d76401 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:05.995338 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a033260b-a4b9-4287-a9b9-d2d853d76401 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:05.996028 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a033260b-a4b9-4287-a9b9-d2d853d76401 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:06.141237 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a033260b-a4b9-4287-a9b9-d2d853d76401 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:06.150656 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a033260b-a4b9-4287-a9b9-d2d853d76401 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:06.152208 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a033260b-a4b9-4287-a9b9-d2d853d76401 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:06.154774 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-a033260b-a4b9-4287-a9b9-d2d853d76401 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.182925 Aug 05 10:31:06.155384 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 326/655] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:31:05 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:31:06.198223 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e39fa0f2-a127-40cf-8a38-20a23377da48 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:06.198793 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e39fa0f2-a127-40cf-8a38-20a23377da48 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:06.206286 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e39fa0f2-a127-40cf-8a38-20a23377da48 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:06.206767 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e39fa0f2-a127-40cf-8a38-20a23377da48 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:06.207226 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e39fa0f2-a127-40cf-8a38-20a23377da48 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:06.207946 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e39fa0f2-a127-40cf-8a38-20a23377da48 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:06.208395 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e39fa0f2-a127-40cf-8a38-20a23377da48 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:06.208818 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e39fa0f2-a127-40cf-8a38-20a23377da48 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:06.421038 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e39fa0f2-a127-40cf-8a38-20a23377da48 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:06.433635 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e39fa0f2-a127-40cf-8a38-20a23377da48 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1754 microversion: 2.1 time: 0.239331 Aug 05 10:31:06.434444 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 330/656] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:06 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1754 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:07.176918 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-0dd6da9b-5356-40ef-8f32-6c741ff6b861 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:07.177525 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-0dd6da9b-5356-40ef-8f32-6c741ff6b861 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:07.184912 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0dd6da9b-5356-40ef-8f32-6c741ff6b861 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:07.185402 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0dd6da9b-5356-40ef-8f32-6c741ff6b861 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:07.185836 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0dd6da9b-5356-40ef-8f32-6c741ff6b861 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:07.186529 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0dd6da9b-5356-40ef-8f32-6c741ff6b861 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:07.187013 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0dd6da9b-5356-40ef-8f32-6c741ff6b861 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:07.187434 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0dd6da9b-5356-40ef-8f32-6c741ff6b861 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:07.325521 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-0dd6da9b-5356-40ef-8f32-6c741ff6b861 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:07.339256 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-0dd6da9b-5356-40ef-8f32-6c741ff6b861 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:07.341623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-0dd6da9b-5356-40ef-8f32-6c741ff6b861 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:07.343470 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-0dd6da9b-5356-40ef-8f32-6c741ff6b861 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.170260 Aug 05 10:31:07.344257 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 327/657] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:31:07 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:31:07.459485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a88797f7-98b0-4553-b03b-e8f176e3cc4b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:07.460555 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a88797f7-98b0-4553-b03b-e8f176e3cc4b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:07.467264 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a88797f7-98b0-4553-b03b-e8f176e3cc4b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:07.467735 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a88797f7-98b0-4553-b03b-e8f176e3cc4b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:07.468153 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a88797f7-98b0-4553-b03b-e8f176e3cc4b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:07.468841 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a88797f7-98b0-4553-b03b-e8f176e3cc4b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:07.469283 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a88797f7-98b0-4553-b03b-e8f176e3cc4b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:07.469702 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a88797f7-98b0-4553-b03b-e8f176e3cc4b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:07.626170 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a88797f7-98b0-4553-b03b-e8f176e3cc4b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:07.638854 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a88797f7-98b0-4553-b03b-e8f176e3cc4b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1754 microversion: 2.1 time: 0.185591 Aug 05 10:31:07.639660 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 331/658] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:07 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1754 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:08.371352 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-895e6afe-b756-47a1-a8cd-8400384d0c6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:08.372405 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-895e6afe-b756-47a1-a8cd-8400384d0c6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:08.376421 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=42 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:31:08.385795 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-895e6afe-b756-47a1-a8cd-8400384d0c6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:08.386577 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-895e6afe-b756-47a1-a8cd-8400384d0c6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:08.387326 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-895e6afe-b756-47a1-a8cd-8400384d0c6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:08.388484 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-895e6afe-b756-47a1-a8cd-8400384d0c6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:08.389231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-895e6afe-b756-47a1-a8cd-8400384d0c6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:08.389922 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-895e6afe-b756-47a1-a8cd-8400384d0c6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:08.594009 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-895e6afe-b756-47a1-a8cd-8400384d0c6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:08.610569 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-895e6afe-b756-47a1-a8cd-8400384d0c6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:08.612107 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-895e6afe-b756-47a1-a8cd-8400384d0c6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:08.613282 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-895e6afe-b756-47a1-a8cd-8400384d0c6a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.249135 Aug 05 10:31:08.613820 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 328/659] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:31:08 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:31:08.664948 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-32dcc243-bcc0-4e96-92ed-7b04c44e2d8b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:08.665673 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-32dcc243-bcc0-4e96-92ed-7b04c44e2d8b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:08.673442 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-32dcc243-bcc0-4e96-92ed-7b04c44e2d8b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:08.673994 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-32dcc243-bcc0-4e96-92ed-7b04c44e2d8b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:08.674496 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-32dcc243-bcc0-4e96-92ed-7b04c44e2d8b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:08.675360 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-32dcc243-bcc0-4e96-92ed-7b04c44e2d8b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:08.675883 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-32dcc243-bcc0-4e96-92ed-7b04c44e2d8b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:08.676392 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-32dcc243-bcc0-4e96-92ed-7b04c44e2d8b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:08.822668 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-32dcc243-bcc0-4e96-92ed-7b04c44e2d8b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:08.831391 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-32dcc243-bcc0-4e96-92ed-7b04c44e2d8b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1754 microversion: 2.1 time: 0.172313 Aug 05 10:31:08.831943 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 332/660] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:08 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:09.640662 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c85f8dcb-b657-4ea1-8784-0da6ce26ece1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:09.641574 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c85f8dcb-b657-4ea1-8784-0da6ce26ece1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:09.652686 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c85f8dcb-b657-4ea1-8784-0da6ce26ece1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:09.653515 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c85f8dcb-b657-4ea1-8784-0da6ce26ece1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:09.654609 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c85f8dcb-b657-4ea1-8784-0da6ce26ece1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:09.655798 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c85f8dcb-b657-4ea1-8784-0da6ce26ece1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:09.656550 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c85f8dcb-b657-4ea1-8784-0da6ce26ece1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:09.657250 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c85f8dcb-b657-4ea1-8784-0da6ce26ece1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:09.678842 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:31:09.799743 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c85f8dcb-b657-4ea1-8784-0da6ce26ece1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:09.808820 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c85f8dcb-b657-4ea1-8784-0da6ce26ece1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:09.810310 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c85f8dcb-b657-4ea1-8784-0da6ce26ece1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:09.811529 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c85f8dcb-b657-4ea1-8784-0da6ce26ece1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.177424 Aug 05 10:31:09.812093 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 329/661] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:31:09 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 10:31:09.857617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-daaa9c58-e413-4aa9-a610-bd082f879f66 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:09.858487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-daaa9c58-e413-4aa9-a610-bd082f879f66 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:09.868108 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-daaa9c58-e413-4aa9-a610-bd082f879f66 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:09.868582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-daaa9c58-e413-4aa9-a610-bd082f879f66 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:09.869012 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-daaa9c58-e413-4aa9-a610-bd082f879f66 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:09.869687 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-daaa9c58-e413-4aa9-a610-bd082f879f66 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:09.870139 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-daaa9c58-e413-4aa9-a610-bd082f879f66 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:09.870554 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-daaa9c58-e413-4aa9-a610-bd082f879f66 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:10.024180 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-daaa9c58-e413-4aa9-a610-bd082f879f66 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:10.033178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-daaa9c58-e413-4aa9-a610-bd082f879f66 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1754 microversion: 2.1 time: 0.181997 Aug 05 10:31:10.033767 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 333/662] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:09 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1754 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:10.547446 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-5f409917-9af1-41d7-b401-ec7c4156d021 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aeb10a98-520c-494d-80ea-7cc61a200ff8"}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:31:10.551373 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-5f409917-9af1-41d7-b401-ec7c4156d021 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:10.559064 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5f409917-9af1-41d7-b401-ec7c4156d021 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:10.559544 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5f409917-9af1-41d7-b401-ec7c4156d021 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:10.559972 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5f409917-9af1-41d7-b401-ec7c4156d021 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:10.560659 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5f409917-9af1-41d7-b401-ec7c4156d021 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:10.561103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5f409917-9af1-41d7-b401-ec7c4156d021 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:10.561521 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5f409917-9af1-41d7-b401-ec7c4156d021 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:10.839554 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-966ffc43-d4cb-44ff-a529-384fcae666e8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:10.840411 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-966ffc43-d4cb-44ff-a529-384fcae666e8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:10.850547 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-966ffc43-d4cb-44ff-a529-384fcae666e8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:10.851176 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-966ffc43-d4cb-44ff-a529-384fcae666e8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:10.851613 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-966ffc43-d4cb-44ff-a529-384fcae666e8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:10.852291 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-966ffc43-d4cb-44ff-a529-384fcae666e8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:10.852732 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-966ffc43-d4cb-44ff-a529-384fcae666e8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:10.853147 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-966ffc43-d4cb-44ff-a529-384fcae666e8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:10.871205 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:31:10.993600 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-966ffc43-d4cb-44ff-a529-384fcae666e8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:11.002377 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-966ffc43-d4cb-44ff-a529-384fcae666e8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:11.003897 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-966ffc43-d4cb-44ff-a529-384fcae666e8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:11.005043 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-966ffc43-d4cb-44ff-a529-384fcae666e8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.172594 Aug 05 10:31:11.005612 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 334/663] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:31:10 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:31:11.054276 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c6230d27-52fc-44ea-9d34-2484761726f7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:11.055177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c6230d27-52fc-44ea-9d34-2484761726f7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:11.058002 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:31:11.065449 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c6230d27-52fc-44ea-9d34-2484761726f7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:11.066220 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c6230d27-52fc-44ea-9d34-2484761726f7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:11.066866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c6230d27-52fc-44ea-9d34-2484761726f7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:11.067885 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c6230d27-52fc-44ea-9d34-2484761726f7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:11.068509 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c6230d27-52fc-44ea-9d34-2484761726f7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:11.068915 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c6230d27-52fc-44ea-9d34-2484761726f7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:11.230235 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c6230d27-52fc-44ea-9d34-2484761726f7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:11.242003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c6230d27-52fc-44ea-9d34-2484761726f7 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1754 microversion: 2.1 time: 0.191378 Aug 05 10:31:11.242571 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 335/664] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:11 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1754 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:12.032993 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-10891eab-899f-4d9a-9443-5ad9bb1b4a47 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:12.034035 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-10891eab-899f-4d9a-9443-5ad9bb1b4a47 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:12.045020 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10891eab-899f-4d9a-9443-5ad9bb1b4a47 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:12.045809 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10891eab-899f-4d9a-9443-5ad9bb1b4a47 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:12.046559 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10891eab-899f-4d9a-9443-5ad9bb1b4a47 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:12.047915 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10891eab-899f-4d9a-9443-5ad9bb1b4a47 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:12.048653 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10891eab-899f-4d9a-9443-5ad9bb1b4a47 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:12.049340 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10891eab-899f-4d9a-9443-5ad9bb1b4a47 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:12.184591 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-10891eab-899f-4d9a-9443-5ad9bb1b4a47 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:12.193492 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-10891eab-899f-4d9a-9443-5ad9bb1b4a47 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:12.195431 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-10891eab-899f-4d9a-9443-5ad9bb1b4a47 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:12.196603 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-10891eab-899f-4d9a-9443-5ad9bb1b4a47 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.170538 Aug 05 10:31:12.197207 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 336/665] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:31:12 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:31:12.264845 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-600c3d1e-5a31-4574-a468-6f167e990289 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:12.265632 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-600c3d1e-5a31-4574-a468-6f167e990289 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:12.273533 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-600c3d1e-5a31-4574-a468-6f167e990289 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:12.274004 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-600c3d1e-5a31-4574-a468-6f167e990289 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:12.274429 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-600c3d1e-5a31-4574-a468-6f167e990289 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:12.275152 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-600c3d1e-5a31-4574-a468-6f167e990289 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:12.275598 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-600c3d1e-5a31-4574-a468-6f167e990289 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:12.276007 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-600c3d1e-5a31-4574-a468-6f167e990289 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:12.438767 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-600c3d1e-5a31-4574-a468-6f167e990289 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:12.449268 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-600c3d1e-5a31-4574-a468-6f167e990289 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1754 microversion: 2.1 time: 0.189296 Aug 05 10:31:12.449831 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 337/666] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:12 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1754 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:13.219719 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-374d5dd6-27cc-4b95-8eab-0d9dce4db148 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:13.220320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-374d5dd6-27cc-4b95-8eab-0d9dce4db148 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:13.227284 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-374d5dd6-27cc-4b95-8eab-0d9dce4db148 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:13.227758 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-374d5dd6-27cc-4b95-8eab-0d9dce4db148 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:13.228187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-374d5dd6-27cc-4b95-8eab-0d9dce4db148 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:13.228874 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-374d5dd6-27cc-4b95-8eab-0d9dce4db148 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:13.229322 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-374d5dd6-27cc-4b95-8eab-0d9dce4db148 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:13.229741 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-374d5dd6-27cc-4b95-8eab-0d9dce4db148 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:13.392139 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-374d5dd6-27cc-4b95-8eab-0d9dce4db148 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:13.406065 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-374d5dd6-27cc-4b95-8eab-0d9dce4db148 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:13.408509 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-374d5dd6-27cc-4b95-8eab-0d9dce4db148 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:13.410278 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-374d5dd6-27cc-4b95-8eab-0d9dce4db148 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.194306 Aug 05 10:31:13.411187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 338/667] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:31:13 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:31:13.473854 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c70888e7-9905-43df-9d4b-5d9a2df07167 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:13.474937 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c70888e7-9905-43df-9d4b-5d9a2df07167 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:13.484827 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c70888e7-9905-43df-9d4b-5d9a2df07167 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:13.485674 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c70888e7-9905-43df-9d4b-5d9a2df07167 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:13.486391 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c70888e7-9905-43df-9d4b-5d9a2df07167 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:13.487748 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c70888e7-9905-43df-9d4b-5d9a2df07167 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:13.488509 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c70888e7-9905-43df-9d4b-5d9a2df07167 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:13.489214 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c70888e7-9905-43df-9d4b-5d9a2df07167 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:13.641930 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c70888e7-9905-43df-9d4b-5d9a2df07167 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:13.652593 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c70888e7-9905-43df-9d4b-5d9a2df07167 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1754 microversion: 2.1 time: 0.184925 Aug 05 10:31:13.653153 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 339/668] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:13 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1754 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:13.959211 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 10:31:13.959471 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Fri Aug 5 10:31:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 10:31:14.439806 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a96ddc78-f58e-4d45-b54b-8e365d1b5cde tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:14.440912 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a96ddc78-f58e-4d45-b54b-8e365d1b5cde tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:14.451682 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a96ddc78-f58e-4d45-b54b-8e365d1b5cde tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:14.452477 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a96ddc78-f58e-4d45-b54b-8e365d1b5cde tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:14.453245 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a96ddc78-f58e-4d45-b54b-8e365d1b5cde tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:14.454423 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a96ddc78-f58e-4d45-b54b-8e365d1b5cde tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:14.455178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a96ddc78-f58e-4d45-b54b-8e365d1b5cde tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:14.455877 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a96ddc78-f58e-4d45-b54b-8e365d1b5cde tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:14.594245 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a96ddc78-f58e-4d45-b54b-8e365d1b5cde tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:14.603670 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a96ddc78-f58e-4d45-b54b-8e365d1b5cde tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:14.605170 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a96ddc78-f58e-4d45-b54b-8e365d1b5cde tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:14.606324 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a96ddc78-f58e-4d45-b54b-8e365d1b5cde tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.173321 Aug 05 10:31:14.606886 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 340/669] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:31:14 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:31:14.677778 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d28bb882-7b84-45d2-a23c-cb7a4cb6e669 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:14.678772 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d28bb882-7b84-45d2-a23c-cb7a4cb6e669 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:14.688774 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d28bb882-7b84-45d2-a23c-cb7a4cb6e669 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:14.689573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d28bb882-7b84-45d2-a23c-cb7a4cb6e669 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:14.690391 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d28bb882-7b84-45d2-a23c-cb7a4cb6e669 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:14.691524 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d28bb882-7b84-45d2-a23c-cb7a4cb6e669 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:14.692279 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d28bb882-7b84-45d2-a23c-cb7a4cb6e669 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:14.692987 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d28bb882-7b84-45d2-a23c-cb7a4cb6e669 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:14.846929 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d28bb882-7b84-45d2-a23c-cb7a4cb6e669 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:14.857062 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d28bb882-7b84-45d2-a23c-cb7a4cb6e669 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1754 microversion: 2.1 time: 0.185430 Aug 05 10:31:14.857628 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 341/670] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:14 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1754 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:31:15.632990 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a6d10fab-b1e2-4266-b278-f7241f0bbd05 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:15.634105 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a6d10fab-b1e2-4266-b278-f7241f0bbd05 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:15.644135 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6d10fab-b1e2-4266-b278-f7241f0bbd05 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:15.644845 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6d10fab-b1e2-4266-b278-f7241f0bbd05 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:15.645491 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6d10fab-b1e2-4266-b278-f7241f0bbd05 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:15.646548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6d10fab-b1e2-4266-b278-f7241f0bbd05 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:15.647272 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6d10fab-b1e2-4266-b278-f7241f0bbd05 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:15.647906 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6d10fab-b1e2-4266-b278-f7241f0bbd05 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:15.802807 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a6d10fab-b1e2-4266-b278-f7241f0bbd05 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:15.811925 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a6d10fab-b1e2-4266-b278-f7241f0bbd05 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:15.813394 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a6d10fab-b1e2-4266-b278-f7241f0bbd05 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:15.814536 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a6d10fab-b1e2-4266-b278-f7241f0bbd05 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.188176 Aug 05 10:31:15.815085 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 342/671] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:31:15 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:31:15.883624 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-31b28477-ca33-4d51-a7f1-865c3a666eac tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:15.884852 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-31b28477-ca33-4d51-a7f1-865c3a666eac tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:15.895598 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31b28477-ca33-4d51-a7f1-865c3a666eac tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:15.896401 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31b28477-ca33-4d51-a7f1-865c3a666eac tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:15.897161 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31b28477-ca33-4d51-a7f1-865c3a666eac tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:15.898282 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31b28477-ca33-4d51-a7f1-865c3a666eac tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:15.899594 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31b28477-ca33-4d51-a7f1-865c3a666eac tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:15.900045 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31b28477-ca33-4d51-a7f1-865c3a666eac tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:16.050401 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-31b28477-ca33-4d51-a7f1-865c3a666eac tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:16.063587 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-31b28477-ca33-4d51-a7f1-865c3a666eac tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1754 microversion: 2.1 time: 0.186311 Aug 05 10:31:16.064360 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 343/672] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:15 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1754 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:16.848930 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-520ce133-0521-4dda-9706-5208392332e0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:16.850069 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-520ce133-0521-4dda-9706-5208392332e0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:16.858653 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-520ce133-0521-4dda-9706-5208392332e0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:16.859178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-520ce133-0521-4dda-9706-5208392332e0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:16.859614 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-520ce133-0521-4dda-9706-5208392332e0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:16.860308 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-520ce133-0521-4dda-9706-5208392332e0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:16.860761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-520ce133-0521-4dda-9706-5208392332e0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:16.861183 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-520ce133-0521-4dda-9706-5208392332e0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:16.998489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-520ce133-0521-4dda-9706-5208392332e0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:17.010563 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-520ce133-0521-4dda-9706-5208392332e0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:17.012115 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-520ce133-0521-4dda-9706-5208392332e0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:17.013284 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-520ce133-0521-4dda-9706-5208392332e0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.170886 Aug 05 10:31:17.013836 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 344/673] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:31:16 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:31:17.091085 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-03dbbe47-4846-4f3f-9b86-bb37267a923c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:17.091710 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-03dbbe47-4846-4f3f-9b86-bb37267a923c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:17.100320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03dbbe47-4846-4f3f-9b86-bb37267a923c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:17.100707 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03dbbe47-4846-4f3f-9b86-bb37267a923c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:17.101138 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03dbbe47-4846-4f3f-9b86-bb37267a923c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:17.101826 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03dbbe47-4846-4f3f-9b86-bb37267a923c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:17.102272 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03dbbe47-4846-4f3f-9b86-bb37267a923c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:17.102699 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03dbbe47-4846-4f3f-9b86-bb37267a923c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:17.269443 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-03dbbe47-4846-4f3f-9b86-bb37267a923c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:17.270188 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-5f409917-9af1-41d7-b401-ec7c4156d021 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "POST /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.729288 Aug 05 10:31:17.270840 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 330/674] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 10:31:10 2022] POST /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9/os-volume_attachments => generated 194 bytes in 6731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:31:17.278045 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-03dbbe47-4846-4f3f-9b86-bb37267a923c tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1754 microversion: 2.1 time: 0.192095 Aug 05 10:31:17.279011 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 345/675] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:17 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1754 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:18.037541 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-20a4218f-29bd-4de8-871c-8796de4e817b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:18.038232 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-20a4218f-29bd-4de8-871c-8796de4e817b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:18.044817 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-20a4218f-29bd-4de8-871c-8796de4e817b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:18.045298 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-20a4218f-29bd-4de8-871c-8796de4e817b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:18.045742 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-20a4218f-29bd-4de8-871c-8796de4e817b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:18.046454 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-20a4218f-29bd-4de8-871c-8796de4e817b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:18.046872 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-20a4218f-29bd-4de8-871c-8796de4e817b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:18.047355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-20a4218f-29bd-4de8-871c-8796de4e817b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:18.183976 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-20a4218f-29bd-4de8-871c-8796de4e817b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:18.193246 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-20a4218f-29bd-4de8-871c-8796de4e817b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:18.194719 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-20a4218f-29bd-4de8-871c-8796de4e817b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:18.195898 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-20a4218f-29bd-4de8-871c-8796de4e817b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.163338 Aug 05 10:31:18.196452 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 331/676] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:31:18 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:31:18.300727 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-93ce3941-b181-4734-80a5-fc7e132486ff tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:18.301389 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-93ce3941-b181-4734-80a5-fc7e132486ff tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:18.308134 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-93ce3941-b181-4734-80a5-fc7e132486ff tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:18.308903 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-93ce3941-b181-4734-80a5-fc7e132486ff tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:18.309339 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-93ce3941-b181-4734-80a5-fc7e132486ff tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:18.310036 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-93ce3941-b181-4734-80a5-fc7e132486ff tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:18.310485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-93ce3941-b181-4734-80a5-fc7e132486ff tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:18.310928 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-93ce3941-b181-4734-80a5-fc7e132486ff tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:18.467225 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-93ce3941-b181-4734-80a5-fc7e132486ff tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:18.476022 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-93ce3941-b181-4734-80a5-fc7e132486ff tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1754 microversion: 2.1 time: 0.179243 Aug 05 10:31:18.476599 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 346/677] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:18 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:19.222638 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ce64ea4a-d293-4742-b71c-446ff01320fa tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:19.223626 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-ce64ea4a-d293-4742-b71c-446ff01320fa tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:19.232959 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ce64ea4a-d293-4742-b71c-446ff01320fa tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:19.233440 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ce64ea4a-d293-4742-b71c-446ff01320fa tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:19.233884 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ce64ea4a-d293-4742-b71c-446ff01320fa tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:19.234566 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ce64ea4a-d293-4742-b71c-446ff01320fa tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:19.235029 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ce64ea4a-d293-4742-b71c-446ff01320fa tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:19.235508 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ce64ea4a-d293-4742-b71c-446ff01320fa tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:19.377004 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ce64ea4a-d293-4742-b71c-446ff01320fa tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:19.389498 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ce64ea4a-d293-4742-b71c-446ff01320fa tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:19.391708 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ce64ea4a-d293-4742-b71c-446ff01320fa tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:19.393542 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ce64ea4a-d293-4742-b71c-446ff01320fa tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.176922 Aug 05 10:31:19.394289 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 332/678] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:31:19 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:31:19.497213 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-03c4da7f-c3d6-48fc-bd0a-0a078b45dab9 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:19.498541 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-03c4da7f-c3d6-48fc-bd0a-0a078b45dab9 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:19.505627 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03c4da7f-c3d6-48fc-bd0a-0a078b45dab9 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:19.506121 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03c4da7f-c3d6-48fc-bd0a-0a078b45dab9 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:19.506555 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03c4da7f-c3d6-48fc-bd0a-0a078b45dab9 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:19.507283 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03c4da7f-c3d6-48fc-bd0a-0a078b45dab9 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:19.507761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03c4da7f-c3d6-48fc-bd0a-0a078b45dab9 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:19.508179 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-03c4da7f-c3d6-48fc-bd0a-0a078b45dab9 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:19.654329 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-03c4da7f-c3d6-48fc-bd0a-0a078b45dab9 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:19.662646 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-03c4da7f-c3d6-48fc-bd0a-0a078b45dab9 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1754 microversion: 2.1 time: 0.169435 Aug 05 10:31:19.663327 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 347/679] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:19 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:20.257656 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-27f87940-b2b6-4a73-802a-add66fff949e req-5b2f1d02-eee1-4b2f-a406-40f507538c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7c11c7-dddb-481d-9d57-af021c48e71b", "name": "network-vif-plugged", "status": "completed", "tag": "9e68983d-a83c-49ba-ac19-3c316e21a882"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:31:20.271837 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-27f87940-b2b6-4a73-802a-add66fff949e req-5b2f1d02-eee1-4b2f-a406-40f507538c5e service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:20.272401 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-27f87940-b2b6-4a73-802a-add66fff949e req-5b2f1d02-eee1-4b2f-a406-40f507538c5e service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:20.272833 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-27f87940-b2b6-4a73-802a-add66fff949e req-5b2f1d02-eee1-4b2f-a406-40f507538c5e service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:20.285591 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-27f87940-b2b6-4a73-802a-add66fff949e req-5b2f1d02-eee1-4b2f-a406-40f507538c5e service nova] Creating event network-vif-plugged:9e68983d-a83c-49ba-ac19-3c316e21a882 for instance af7c11c7-dddb-481d-9d57-af021c48e71b on hv-cinder-81558 Aug 05 10:31:20.291081 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-27f87940-b2b6-4a73-802a-add66fff949e req-5b2f1d02-eee1-4b2f-a406-40f507538c5e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038163 Aug 05 10:31:20.291688 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 333/680] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:31:20.417462 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3a75cbdf-421d-4021-8236-4546d6d9c172 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:20.418064 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3a75cbdf-421d-4021-8236-4546d6d9c172 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:20.424833 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3a75cbdf-421d-4021-8236-4546d6d9c172 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:20.425316 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3a75cbdf-421d-4021-8236-4546d6d9c172 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:20.425749 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3a75cbdf-421d-4021-8236-4546d6d9c172 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:20.426575 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3a75cbdf-421d-4021-8236-4546d6d9c172 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:20.427067 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3a75cbdf-421d-4021-8236-4546d6d9c172 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:20.427485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3a75cbdf-421d-4021-8236-4546d6d9c172 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:20.563487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3a75cbdf-421d-4021-8236-4546d6d9c172 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:20.572382 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3a75cbdf-421d-4021-8236-4546d6d9c172 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:20.573929 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3a75cbdf-421d-4021-8236-4546d6d9c172 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:20.575132 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3a75cbdf-421d-4021-8236-4546d6d9c172 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.161767 Aug 05 10:31:20.578569 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 348/681] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:31:20 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:31:20.685528 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-fc520a9e-6232-4d2f-991f-a7d63e88cb28 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:20.686255 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-fc520a9e-6232-4d2f-991f-a7d63e88cb28 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:20.693031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fc520a9e-6232-4d2f-991f-a7d63e88cb28 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:20.693528 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fc520a9e-6232-4d2f-991f-a7d63e88cb28 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:20.693949 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fc520a9e-6232-4d2f-991f-a7d63e88cb28 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:20.694649 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fc520a9e-6232-4d2f-991f-a7d63e88cb28 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:20.695151 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fc520a9e-6232-4d2f-991f-a7d63e88cb28 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:20.695594 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fc520a9e-6232-4d2f-991f-a7d63e88cb28 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:20.850819 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-fc520a9e-6232-4d2f-991f-a7d63e88cb28 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:20.859312 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-fc520a9e-6232-4d2f-991f-a7d63e88cb28 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1754 microversion: 2.1 time: 0.178199 Aug 05 10:31:20.859886 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 334/682] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:20 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:21.598310 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e10f728b-f77b-480d-9428-b9df577c63a1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:21.598946 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e10f728b-f77b-480d-9428-b9df577c63a1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:21.606930 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e10f728b-f77b-480d-9428-b9df577c63a1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:21.607717 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e10f728b-f77b-480d-9428-b9df577c63a1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:21.608932 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e10f728b-f77b-480d-9428-b9df577c63a1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:21.609951 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e10f728b-f77b-480d-9428-b9df577c63a1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:21.610468 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e10f728b-f77b-480d-9428-b9df577c63a1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:21.611392 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e10f728b-f77b-480d-9428-b9df577c63a1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:21.742169 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e10f728b-f77b-480d-9428-b9df577c63a1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:21.750736 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e10f728b-f77b-480d-9428-b9df577c63a1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:21.752237 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e10f728b-f77b-480d-9428-b9df577c63a1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:21.753399 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e10f728b-f77b-480d-9428-b9df577c63a1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.159486 Aug 05 10:31:21.753943 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 349/683] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:31:21 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:31:21.884647 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-24822f51-f15d-4d99-8c92-ac8a2dde1d4e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:21.885526 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-24822f51-f15d-4d99-8c92-ac8a2dde1d4e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:21.896783 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-24822f51-f15d-4d99-8c92-ac8a2dde1d4e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:21.897590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-24822f51-f15d-4d99-8c92-ac8a2dde1d4e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:21.898361 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-24822f51-f15d-4d99-8c92-ac8a2dde1d4e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:21.899555 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-24822f51-f15d-4d99-8c92-ac8a2dde1d4e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:21.900362 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-24822f51-f15d-4d99-8c92-ac8a2dde1d4e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:21.901082 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-24822f51-f15d-4d99-8c92-ac8a2dde1d4e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:22.070039 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-24822f51-f15d-4d99-8c92-ac8a2dde1d4e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:22.078746 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-24822f51-f15d-4d99-8c92-ac8a2dde1d4e tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1757 microversion: 2.1 time: 0.200780 Aug 05 10:31:22.079360 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 335/684] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:21 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1757 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:22.776549 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4226f57e-da6e-43d9-b7ba-55ae80858858 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:22.777606 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4226f57e-da6e-43d9-b7ba-55ae80858858 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:22.784850 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4226f57e-da6e-43d9-b7ba-55ae80858858 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:22.785337 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4226f57e-da6e-43d9-b7ba-55ae80858858 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:22.785770 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4226f57e-da6e-43d9-b7ba-55ae80858858 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:22.786462 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4226f57e-da6e-43d9-b7ba-55ae80858858 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:22.786912 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4226f57e-da6e-43d9-b7ba-55ae80858858 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:22.787371 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4226f57e-da6e-43d9-b7ba-55ae80858858 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:22.919925 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4226f57e-da6e-43d9-b7ba-55ae80858858 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:22.928411 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4226f57e-da6e-43d9-b7ba-55ae80858858 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:22.929901 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4226f57e-da6e-43d9-b7ba-55ae80858858 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:22.931066 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4226f57e-da6e-43d9-b7ba-55ae80858858 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.158621 Aug 05 10:31:22.931611 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 350/685] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:31:22 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:31:23.961653 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-6bf2e541-73c4-4649-98af-65a7491641e2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:23.962455 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-6bf2e541-73c4-4649-98af-65a7491641e2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:23.969401 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6bf2e541-73c4-4649-98af-65a7491641e2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:23.969886 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6bf2e541-73c4-4649-98af-65a7491641e2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:23.970304 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6bf2e541-73c4-4649-98af-65a7491641e2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:23.971025 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6bf2e541-73c4-4649-98af-65a7491641e2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:23.971471 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6bf2e541-73c4-4649-98af-65a7491641e2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:23.971905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6bf2e541-73c4-4649-98af-65a7491641e2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:24.113156 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-6bf2e541-73c4-4649-98af-65a7491641e2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:24.123813 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-6bf2e541-73c4-4649-98af-65a7491641e2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:24.125097 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-6bf2e541-73c4-4649-98af-65a7491641e2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:24.126279 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-6bf2e541-73c4-4649-98af-65a7491641e2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1809 microversion: 2.20 time: 0.168604 Aug 05 10:31:24.126913 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 336/686] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:31:23 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:31:25.151831 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4a16998c-500e-4b36-b551-c2085e8aa233 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:25.152581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4a16998c-500e-4b36-b551-c2085e8aa233 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:25.160458 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a16998c-500e-4b36-b551-c2085e8aa233 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:25.160915 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a16998c-500e-4b36-b551-c2085e8aa233 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:25.161346 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a16998c-500e-4b36-b551-c2085e8aa233 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:25.162046 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a16998c-500e-4b36-b551-c2085e8aa233 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:25.162491 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a16998c-500e-4b36-b551-c2085e8aa233 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:25.162932 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a16998c-500e-4b36-b551-c2085e8aa233 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:25.167105 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:31:25.320004 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4a16998c-500e-4b36-b551-c2085e8aa233 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:25.328546 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4a16998c-500e-4b36-b551-c2085e8aa233 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:25.330055 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4a16998c-500e-4b36-b551-c2085e8aa233 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:25.331217 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4a16998c-500e-4b36-b551-c2085e8aa233 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1796 microversion: 2.20 time: 0.183483 Aug 05 10:31:25.331768 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 351/687] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:31:25 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1796 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:31:26.078557 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-a3ce9c1b-ca52-4a89-9e59-0ae198dc8636 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:31:26.080905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-a3ce9c1b-ca52-4a89-9e59-0ae198dc8636 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:26.090075 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a3ce9c1b-ca52-4a89-9e59-0ae198dc8636 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:26.090933 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a3ce9c1b-ca52-4a89-9e59-0ae198dc8636 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:26.091701 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a3ce9c1b-ca52-4a89-9e59-0ae198dc8636 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:26.092863 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a3ce9c1b-ca52-4a89-9e59-0ae198dc8636 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:26.093654 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a3ce9c1b-ca52-4a89-9e59-0ae198dc8636 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:26.094372 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a3ce9c1b-ca52-4a89-9e59-0ae198dc8636 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:26.127870 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.objects.instance [None req-a3ce9c1b-ca52-4a89-9e59-0ae198dc8636 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lazy-loading 'flavor' on Instance uuid 94bc927e-f379-4a93-a980-289f58af66f9 {{(pid=117831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:31:26.294660 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-a3ce9c1b-ca52-4a89-9e59-0ae198dc8636 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "POST /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9/action" status: 200 len: 32 microversion: 2.1 time: 0.220497 Aug 05 10:31:26.295254 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 337/688] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 10:31:26 2022] POST /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9/action => generated 32 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 10:31:26.305142 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-28799a84-b3a4-4bc5-83fb-50e684736ec8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:26.305775 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-28799a84-b3a4-4bc5-83fb-50e684736ec8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:26.312285 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-28799a84-b3a4-4bc5-83fb-50e684736ec8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:26.312779 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-28799a84-b3a4-4bc5-83fb-50e684736ec8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:26.313251 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-28799a84-b3a4-4bc5-83fb-50e684736ec8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:26.314397 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-28799a84-b3a4-4bc5-83fb-50e684736ec8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:26.314854 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-28799a84-b3a4-4bc5-83fb-50e684736ec8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:26.315309 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-28799a84-b3a4-4bc5-83fb-50e684736ec8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:26.458183 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-28799a84-b3a4-4bc5-83fb-50e684736ec8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:26.467636 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-28799a84-b3a4-4bc5-83fb-50e684736ec8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1734 microversion: 2.1 time: 0.166487 Aug 05 10:31:26.468177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 352/689] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:26 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:27.494202 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-57d0f835-5c20-4337-a773-cc119f8fa2b6 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:27.495371 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-57d0f835-5c20-4337-a773-cc119f8fa2b6 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:27.506061 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-57d0f835-5c20-4337-a773-cc119f8fa2b6 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:27.506845 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-57d0f835-5c20-4337-a773-cc119f8fa2b6 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:27.507610 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-57d0f835-5c20-4337-a773-cc119f8fa2b6 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:27.508746 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-57d0f835-5c20-4337-a773-cc119f8fa2b6 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:27.509485 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-57d0f835-5c20-4337-a773-cc119f8fa2b6 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:27.510221 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-57d0f835-5c20-4337-a773-cc119f8fa2b6 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:27.653986 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-57d0f835-5c20-4337-a773-cc119f8fa2b6 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:27.662171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-57d0f835-5c20-4337-a773-cc119f8fa2b6 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1734 microversion: 2.1 time: 0.175788 Aug 05 10:31:27.662748 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 338/690] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:27 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:28.688380 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-049eb126-315b-4627-b55f-91f6621c087b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:28.689314 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-049eb126-315b-4627-b55f-91f6621c087b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:28.700626 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-049eb126-315b-4627-b55f-91f6621c087b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:28.701108 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-049eb126-315b-4627-b55f-91f6621c087b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:28.701538 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-049eb126-315b-4627-b55f-91f6621c087b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:28.702226 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-049eb126-315b-4627-b55f-91f6621c087b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:28.702679 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-049eb126-315b-4627-b55f-91f6621c087b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:28.703130 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-049eb126-315b-4627-b55f-91f6621c087b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:28.836623 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-049eb126-315b-4627-b55f-91f6621c087b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:28.849448 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-049eb126-315b-4627-b55f-91f6621c087b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1734 microversion: 2.1 time: 0.167612 Aug 05 10:31:28.850226 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 353/691] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:28 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:29.877998 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b1334af0-b90c-4ef5-a38e-93d3e6e9ed6c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:29.878857 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b1334af0-b90c-4ef5-a38e-93d3e6e9ed6c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:29.891942 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b1334af0-b90c-4ef5-a38e-93d3e6e9ed6c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:29.893303 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b1334af0-b90c-4ef5-a38e-93d3e6e9ed6c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:29.894502 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b1334af0-b90c-4ef5-a38e-93d3e6e9ed6c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:29.895921 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b1334af0-b90c-4ef5-a38e-93d3e6e9ed6c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:29.896925 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b1334af0-b90c-4ef5-a38e-93d3e6e9ed6c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:29.897744 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b1334af0-b90c-4ef5-a38e-93d3e6e9ed6c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:30.047308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b1334af0-b90c-4ef5-a38e-93d3e6e9ed6c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:30.055860 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b1334af0-b90c-4ef5-a38e-93d3e6e9ed6c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1734 microversion: 2.1 time: 0.185345 Aug 05 10:31:30.056423 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 339/692] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:29 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1734 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:31.078963 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2e2405e8-a98e-4e87-9f22-8173b9a50a3b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:31.079619 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2e2405e8-a98e-4e87-9f22-8173b9a50a3b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:31.086483 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e2405e8-a98e-4e87-9f22-8173b9a50a3b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:31.087005 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e2405e8-a98e-4e87-9f22-8173b9a50a3b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:31.087440 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e2405e8-a98e-4e87-9f22-8173b9a50a3b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:31.088146 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e2405e8-a98e-4e87-9f22-8173b9a50a3b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:31.088603 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e2405e8-a98e-4e87-9f22-8173b9a50a3b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:31.089027 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e2405e8-a98e-4e87-9f22-8173b9a50a3b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:31.224698 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2e2405e8-a98e-4e87-9f22-8173b9a50a3b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:31.233093 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2e2405e8-a98e-4e87-9f22-8173b9a50a3b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1734 microversion: 2.1 time: 0.158833 Aug 05 10:31:31.233659 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 354/693] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:31 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:32.258332 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f3d1ee93-af56-43b9-adae-2c7b0f525414 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:32.259367 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f3d1ee93-af56-43b9-adae-2c7b0f525414 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:32.270521 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f3d1ee93-af56-43b9-adae-2c7b0f525414 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:32.271375 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f3d1ee93-af56-43b9-adae-2c7b0f525414 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:32.272140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f3d1ee93-af56-43b9-adae-2c7b0f525414 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:32.273264 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f3d1ee93-af56-43b9-adae-2c7b0f525414 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:32.274007 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f3d1ee93-af56-43b9-adae-2c7b0f525414 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:32.274699 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f3d1ee93-af56-43b9-adae-2c7b0f525414 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:32.422620 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-f3d1ee93-af56-43b9-adae-2c7b0f525414 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:32.431044 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f3d1ee93-af56-43b9-adae-2c7b0f525414 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1734 microversion: 2.1 time: 0.179117 Aug 05 10:31:32.431616 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 340/694] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:32 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:33.458468 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6ede902d-9ec8-4a5c-a16b-e057c19e8a27 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:33.459341 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6ede902d-9ec8-4a5c-a16b-e057c19e8a27 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:33.470309 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ede902d-9ec8-4a5c-a16b-e057c19e8a27 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:33.471162 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ede902d-9ec8-4a5c-a16b-e057c19e8a27 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:33.471872 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ede902d-9ec8-4a5c-a16b-e057c19e8a27 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:33.473020 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ede902d-9ec8-4a5c-a16b-e057c19e8a27 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:33.473738 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ede902d-9ec8-4a5c-a16b-e057c19e8a27 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:33.474433 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ede902d-9ec8-4a5c-a16b-e057c19e8a27 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:33.621560 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6ede902d-9ec8-4a5c-a16b-e057c19e8a27 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:33.630588 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6ede902d-9ec8-4a5c-a16b-e057c19e8a27 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1734 microversion: 2.1 time: 0.176794 Aug 05 10:31:33.631210 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 355/695] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:33 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:34.655874 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f3fb5fb0-bbd0-469b-9d62-567646f682b9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:34.656485 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f3fb5fb0-bbd0-469b-9d62-567646f682b9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:34.676739 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f3fb5fb0-bbd0-469b-9d62-567646f682b9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:34.677216 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f3fb5fb0-bbd0-469b-9d62-567646f682b9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:34.677795 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f3fb5fb0-bbd0-469b-9d62-567646f682b9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:34.678524 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f3fb5fb0-bbd0-469b-9d62-567646f682b9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:34.679013 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f3fb5fb0-bbd0-469b-9d62-567646f682b9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:34.679550 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f3fb5fb0-bbd0-469b-9d62-567646f682b9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:34.817121 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-f3fb5fb0-bbd0-469b-9d62-567646f682b9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:34.825310 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f3fb5fb0-bbd0-469b-9d62-567646f682b9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1734 microversion: 2.1 time: 0.175675 Aug 05 10:31:34.826160 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 341/696] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:34 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:35.857823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d37126c4-12dc-4d7e-b23a-5854d3c4aa78 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:35.858837 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d37126c4-12dc-4d7e-b23a-5854d3c4aa78 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:35.869679 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d37126c4-12dc-4d7e-b23a-5854d3c4aa78 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:35.870478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d37126c4-12dc-4d7e-b23a-5854d3c4aa78 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:35.871257 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d37126c4-12dc-4d7e-b23a-5854d3c4aa78 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:35.872474 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d37126c4-12dc-4d7e-b23a-5854d3c4aa78 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:35.872927 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d37126c4-12dc-4d7e-b23a-5854d3c4aa78 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:35.873347 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d37126c4-12dc-4d7e-b23a-5854d3c4aa78 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:36.005777 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d37126c4-12dc-4d7e-b23a-5854d3c4aa78 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:36.014386 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d37126c4-12dc-4d7e-b23a-5854d3c4aa78 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1734 microversion: 2.1 time: 0.163118 Aug 05 10:31:36.014938 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 356/697] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:35 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:37.039791 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c6692bd1-635a-4a92-bf0f-8f2bc8b37a84 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:37.040707 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c6692bd1-635a-4a92-bf0f-8f2bc8b37a84 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:37.049107 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6692bd1-635a-4a92-bf0f-8f2bc8b37a84 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:37.049589 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6692bd1-635a-4a92-bf0f-8f2bc8b37a84 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:37.050019 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6692bd1-635a-4a92-bf0f-8f2bc8b37a84 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:37.050710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6692bd1-635a-4a92-bf0f-8f2bc8b37a84 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:37.051191 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6692bd1-635a-4a92-bf0f-8f2bc8b37a84 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:37.051606 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6692bd1-635a-4a92-bf0f-8f2bc8b37a84 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:37.190297 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c6692bd1-635a-4a92-bf0f-8f2bc8b37a84 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:37.198729 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c6692bd1-635a-4a92-bf0f-8f2bc8b37a84 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1734 microversion: 2.1 time: 0.165317 Aug 05 10:31:37.199340 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 342/698] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:37 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:38.224738 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-70bff2da-37de-41e8-8be5-502c022a3b38 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:38.225833 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-70bff2da-37de-41e8-8be5-502c022a3b38 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:38.237216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70bff2da-37de-41e8-8be5-502c022a3b38 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:38.238005 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70bff2da-37de-41e8-8be5-502c022a3b38 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:38.238720 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70bff2da-37de-41e8-8be5-502c022a3b38 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:38.239969 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70bff2da-37de-41e8-8be5-502c022a3b38 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:38.240713 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70bff2da-37de-41e8-8be5-502c022a3b38 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:38.241414 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70bff2da-37de-41e8-8be5-502c022a3b38 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:38.378278 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-70bff2da-37de-41e8-8be5-502c022a3b38 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:38.386444 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-70bff2da-37de-41e8-8be5-502c022a3b38 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1734 microversion: 2.1 time: 0.168480 Aug 05 10:31:38.387032 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 357/699] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:38 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:39.363033 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-aacd0017-fbcd-41bb-8fd6-4c3b1d37014a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:39.363557 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-aacd0017-fbcd-41bb-8fd6-4c3b1d37014a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:39.365509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=30 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:31:39.370691 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aacd0017-fbcd-41bb-8fd6-4c3b1d37014a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:39.371199 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aacd0017-fbcd-41bb-8fd6-4c3b1d37014a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:39.371622 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aacd0017-fbcd-41bb-8fd6-4c3b1d37014a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:39.372852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aacd0017-fbcd-41bb-8fd6-4c3b1d37014a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:39.373309 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aacd0017-fbcd-41bb-8fd6-4c3b1d37014a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:39.373747 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aacd0017-fbcd-41bb-8fd6-4c3b1d37014a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:39.408154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7aa1fc4b-6680-40f2-9943-15470b305280 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:39.408720 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7aa1fc4b-6680-40f2-9943-15470b305280 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:39.414701 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7aa1fc4b-6680-40f2-9943-15470b305280 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:39.415218 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7aa1fc4b-6680-40f2-9943-15470b305280 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:39.415660 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7aa1fc4b-6680-40f2-9943-15470b305280 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:39.416286 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7aa1fc4b-6680-40f2-9943-15470b305280 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:39.416726 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7aa1fc4b-6680-40f2-9943-15470b305280 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:39.417258 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7aa1fc4b-6680-40f2-9943-15470b305280 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:39.432383 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:31:39.507015 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.objects.instance [None req-aacd0017-fbcd-41bb-8fd6-4c3b1d37014a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lazy-loading 'services' on Instance uuid 6cef9d70-01bd-4d04-829d-2495d889f34a {{(pid=117831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:31:39.550936 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7aa1fc4b-6680-40f2-9943-15470b305280 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:39.559268 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7aa1fc4b-6680-40f2-9943-15470b305280 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1734 microversion: 2.1 time: 0.156102 Aug 05 10:31:39.559914 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 358/700] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:39 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:39.633667 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-aacd0017-fbcd-41bb-8fd6-4c3b1d37014a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a/os-volume_attachments/40b8050a-869e-401c-bec5-e2ae81488822" status: 202 len: 0 microversion: 2.1 time: 0.394615 Aug 05 10:31:39.634236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 343/701] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 5 10:31:39 2022] DELETE /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a/os-volume_attachments/40b8050a-869e-401c-bec5-e2ae81488822 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:31:40.580726 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a630ea8a-2f2f-424e-be37-2a3be00b4229 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:40.581334 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a630ea8a-2f2f-424e-be37-2a3be00b4229 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:40.588109 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a630ea8a-2f2f-424e-be37-2a3be00b4229 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:40.588587 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a630ea8a-2f2f-424e-be37-2a3be00b4229 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:40.589020 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a630ea8a-2f2f-424e-be37-2a3be00b4229 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:40.589742 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a630ea8a-2f2f-424e-be37-2a3be00b4229 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:40.590188 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a630ea8a-2f2f-424e-be37-2a3be00b4229 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:40.590614 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a630ea8a-2f2f-424e-be37-2a3be00b4229 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:40.725021 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a630ea8a-2f2f-424e-be37-2a3be00b4229 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:40.733386 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a630ea8a-2f2f-424e-be37-2a3be00b4229 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1734 microversion: 2.1 time: 0.156396 Aug 05 10:31:40.734028 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 359/702] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:40 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:41.760936 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-1ca78d13-1442-4225-b2ae-aea8c43bc89b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:41.762023 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-1ca78d13-1442-4225-b2ae-aea8c43bc89b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:41.769664 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1ca78d13-1442-4225-b2ae-aea8c43bc89b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:41.770125 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1ca78d13-1442-4225-b2ae-aea8c43bc89b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:41.770571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1ca78d13-1442-4225-b2ae-aea8c43bc89b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:41.771305 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1ca78d13-1442-4225-b2ae-aea8c43bc89b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:41.771756 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1ca78d13-1442-4225-b2ae-aea8c43bc89b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:41.772174 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1ca78d13-1442-4225-b2ae-aea8c43bc89b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:41.823500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b325392f-e388-4c3e-998d-2ccc3d816992 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:31:41.826330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=50 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:31:41.832214 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b325392f-e388-4c3e-998d-2ccc3d816992 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:41.832688 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b325392f-e388-4c3e-998d-2ccc3d816992 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:41.833122 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b325392f-e388-4c3e-998d-2ccc3d816992 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:41.857715 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b325392f-e388-4c3e-998d-2ccc3d816992 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Going to try to stop instance {{(pid=117832) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 05 10:31:41.903715 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b325392f-e388-4c3e-998d-2ccc3d816992 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "POST /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a/action" status: 202 len: 0 microversion: 2.1 time: 0.083502 Aug 05 10:31:41.904326 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 360/703] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 10:31:41 2022] POST /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:31:41.908135 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-1ca78d13-1442-4225-b2ae-aea8c43bc89b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:41.912968 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-aa79a169-420d-4847-a199-7527de65cb85 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:41.913655 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-aa79a169-420d-4847-a199-7527de65cb85 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:41.918404 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-1ca78d13-1442-4225-b2ae-aea8c43bc89b tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1734 microversion: 2.1 time: 0.165391 Aug 05 10:31:41.919827 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 344/704] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:41 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:41.920107 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aa79a169-420d-4847-a199-7527de65cb85 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:41.920698 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aa79a169-420d-4847-a199-7527de65cb85 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:41.921134 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aa79a169-420d-4847-a199-7527de65cb85 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:41.921987 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aa79a169-420d-4847-a199-7527de65cb85 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:41.922347 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aa79a169-420d-4847-a199-7527de65cb85 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:41.922771 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aa79a169-420d-4847-a199-7527de65cb85 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:42.071714 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-aa79a169-420d-4847-a199-7527de65cb85 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:42.082466 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-aa79a169-420d-4847-a199-7527de65cb85 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1675 microversion: 2.1 time: 0.173162 Aug 05 10:31:42.083176 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 361/705] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:41 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:31:42.944667 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-6f4ce1ac-c399-4ed1-a775-129aa12224f0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:42.945596 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-6f4ce1ac-c399-4ed1-a775-129aa12224f0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:42.954958 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6f4ce1ac-c399-4ed1-a775-129aa12224f0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:42.955528 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6f4ce1ac-c399-4ed1-a775-129aa12224f0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:42.956064 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6f4ce1ac-c399-4ed1-a775-129aa12224f0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:42.957050 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6f4ce1ac-c399-4ed1-a775-129aa12224f0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:42.957495 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6f4ce1ac-c399-4ed1-a775-129aa12224f0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:42.958030 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6f4ce1ac-c399-4ed1-a775-129aa12224f0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:43.097153 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-6f4ce1ac-c399-4ed1-a775-129aa12224f0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:43.105288 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-6f4ce1ac-c399-4ed1-a775-129aa12224f0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1734 microversion: 2.1 time: 0.167093 Aug 05 10:31:43.105890 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 345/706] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:42 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:43.106393 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-afecccad-4e0a-4b34-aabb-5bd7457a50f9 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:43.107147 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-afecccad-4e0a-4b34-aabb-5bd7457a50f9 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:43.113799 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afecccad-4e0a-4b34-aabb-5bd7457a50f9 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:43.114282 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afecccad-4e0a-4b34-aabb-5bd7457a50f9 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:43.114719 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afecccad-4e0a-4b34-aabb-5bd7457a50f9 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:43.115444 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afecccad-4e0a-4b34-aabb-5bd7457a50f9 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:43.115898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afecccad-4e0a-4b34-aabb-5bd7457a50f9 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:43.116319 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afecccad-4e0a-4b34-aabb-5bd7457a50f9 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:43.255504 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-afecccad-4e0a-4b34-aabb-5bd7457a50f9 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:43.263972 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-afecccad-4e0a-4b34-aabb-5bd7457a50f9 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1675 microversion: 2.1 time: 0.161542 Aug 05 10:31:43.264541 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 362/707] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:43 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:44.130800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-aa981c3f-7ea4-4b24-8b43-a63de18cd1d9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:44.131924 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-aa981c3f-7ea4-4b24-8b43-a63de18cd1d9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:44.142959 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aa981c3f-7ea4-4b24-8b43-a63de18cd1d9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:44.143802 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aa981c3f-7ea4-4b24-8b43-a63de18cd1d9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:44.144666 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aa981c3f-7ea4-4b24-8b43-a63de18cd1d9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:44.145803 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aa981c3f-7ea4-4b24-8b43-a63de18cd1d9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:44.146546 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aa981c3f-7ea4-4b24-8b43-a63de18cd1d9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:44.147296 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aa981c3f-7ea4-4b24-8b43-a63de18cd1d9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:44.288768 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-44da06fb-091e-4e58-abc8-28c341e77e47 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:44.289729 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-44da06fb-091e-4e58-abc8-28c341e77e47 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:44.297025 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-aa981c3f-7ea4-4b24-8b43-a63de18cd1d9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:44.300273 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-44da06fb-091e-4e58-abc8-28c341e77e47 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:44.301076 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-44da06fb-091e-4e58-abc8-28c341e77e47 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:44.301799 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-44da06fb-091e-4e58-abc8-28c341e77e47 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:44.302980 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-44da06fb-091e-4e58-abc8-28c341e77e47 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:44.303726 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-44da06fb-091e-4e58-abc8-28c341e77e47 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:44.304428 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-44da06fb-091e-4e58-abc8-28c341e77e47 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:44.310181 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-aa981c3f-7ea4-4b24-8b43-a63de18cd1d9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1734 microversion: 2.1 time: 0.185650 Aug 05 10:31:44.310755 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 346/708] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:44 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1734 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:44.444025 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-44da06fb-091e-4e58-abc8-28c341e77e47 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:44.453725 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-44da06fb-091e-4e58-abc8-28c341e77e47 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1675 microversion: 2.1 time: 0.171540 Aug 05 10:31:44.454285 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 363/709] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:44 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:45.336245 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-a3f92f5e-e1ee-46be-b9bb-9f899d6dab6a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:45.337123 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-a3f92f5e-e1ee-46be-b9bb-9f899d6dab6a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:45.348367 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a3f92f5e-e1ee-46be-b9bb-9f899d6dab6a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:45.349170 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a3f92f5e-e1ee-46be-b9bb-9f899d6dab6a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:45.349921 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a3f92f5e-e1ee-46be-b9bb-9f899d6dab6a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:45.351376 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a3f92f5e-e1ee-46be-b9bb-9f899d6dab6a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:45.352153 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a3f92f5e-e1ee-46be-b9bb-9f899d6dab6a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:45.352871 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a3f92f5e-e1ee-46be-b9bb-9f899d6dab6a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:45.483761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1108579d-e60d-4ac1-9c9d-7643b9903360 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:45.484374 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1108579d-e60d-4ac1-9c9d-7643b9903360 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:45.488631 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a3f92f5e-e1ee-46be-b9bb-9f899d6dab6a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:45.490730 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1108579d-e60d-4ac1-9c9d-7643b9903360 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:45.491239 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1108579d-e60d-4ac1-9c9d-7643b9903360 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:45.491671 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1108579d-e60d-4ac1-9c9d-7643b9903360 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:45.492367 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1108579d-e60d-4ac1-9c9d-7643b9903360 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:45.492814 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1108579d-e60d-4ac1-9c9d-7643b9903360 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:45.493235 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1108579d-e60d-4ac1-9c9d-7643b9903360 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:45.496791 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-a3f92f5e-e1ee-46be-b9bb-9f899d6dab6a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1734 microversion: 2.1 time: 0.167316 Aug 05 10:31:45.497406 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 347/710] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:45 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:45.632430 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1108579d-e60d-4ac1-9c9d-7643b9903360 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:45.644344 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1108579d-e60d-4ac1-9c9d-7643b9903360 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1675 microversion: 2.1 time: 0.165312 Aug 05 10:31:45.645088 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 364/711] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:45 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:46.518507 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-a6074254-1027-456a-9d2a-e48b5012a339 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:46.519150 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-a6074254-1027-456a-9d2a-e48b5012a339 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:46.526175 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a6074254-1027-456a-9d2a-e48b5012a339 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:46.526655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a6074254-1027-456a-9d2a-e48b5012a339 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:46.527121 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a6074254-1027-456a-9d2a-e48b5012a339 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:46.528241 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a6074254-1027-456a-9d2a-e48b5012a339 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:46.528951 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a6074254-1027-456a-9d2a-e48b5012a339 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:46.529402 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a6074254-1027-456a-9d2a-e48b5012a339 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:46.670924 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-69e80160-c566-40cb-a9ba-38b76abaf91d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:46.671967 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-69e80160-c566-40cb-a9ba-38b76abaf91d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:46.682468 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69e80160-c566-40cb-a9ba-38b76abaf91d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:46.683119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69e80160-c566-40cb-a9ba-38b76abaf91d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:46.683717 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69e80160-c566-40cb-a9ba-38b76abaf91d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:46.684736 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69e80160-c566-40cb-a9ba-38b76abaf91d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:46.685377 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69e80160-c566-40cb-a9ba-38b76abaf91d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:46.686006 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69e80160-c566-40cb-a9ba-38b76abaf91d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:46.703821 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a6074254-1027-456a-9d2a-e48b5012a339 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:46.713159 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-a6074254-1027-456a-9d2a-e48b5012a339 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1734 microversion: 2.1 time: 0.198417 Aug 05 10:31:46.714081 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 348/712] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:46 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1734 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:46.835282 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-69e80160-c566-40cb-a9ba-38b76abaf91d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:46.843630 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-69e80160-c566-40cb-a9ba-38b76abaf91d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1675 microversion: 2.1 time: 0.178001 Aug 05 10:31:46.844164 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 365/713] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:46 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1675 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:47.740108 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-25818eb8-fc63-4a76-9382-7c2e360d1d4a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:47.741074 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-25818eb8-fc63-4a76-9382-7c2e360d1d4a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:47.753159 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-25818eb8-fc63-4a76-9382-7c2e360d1d4a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:47.753973 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-25818eb8-fc63-4a76-9382-7c2e360d1d4a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:47.754700 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-25818eb8-fc63-4a76-9382-7c2e360d1d4a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:47.755947 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-25818eb8-fc63-4a76-9382-7c2e360d1d4a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:47.756715 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-25818eb8-fc63-4a76-9382-7c2e360d1d4a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:47.757425 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-25818eb8-fc63-4a76-9382-7c2e360d1d4a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:47.865176 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-48845cec-267c-4d94-839d-2c18c6028f42 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:47.865806 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-48845cec-267c-4d94-839d-2c18c6028f42 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:47.873349 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-48845cec-267c-4d94-839d-2c18c6028f42 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:47.873830 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-48845cec-267c-4d94-839d-2c18c6028f42 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:47.874263 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-48845cec-267c-4d94-839d-2c18c6028f42 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:47.874950 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-48845cec-267c-4d94-839d-2c18c6028f42 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:47.875425 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-48845cec-267c-4d94-839d-2c18c6028f42 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:47.875839 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-48845cec-267c-4d94-839d-2c18c6028f42 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:47.899439 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-25818eb8-fc63-4a76-9382-7c2e360d1d4a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:47.908383 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-25818eb8-fc63-4a76-9382-7c2e360d1d4a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1714 microversion: 2.1 time: 0.174772 Aug 05 10:31:47.908957 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 349/714] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:47 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1714 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:47.970653 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f1ff48b5-d672-4ac9-b33a-e367e79bcf07 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:47.971182 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f1ff48b5-d672-4ac9-b33a-e367e79bcf07 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:47.977043 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f1ff48b5-d672-4ac9-b33a-e367e79bcf07 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:47.977526 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f1ff48b5-d672-4ac9-b33a-e367e79bcf07 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:47.977962 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f1ff48b5-d672-4ac9-b33a-e367e79bcf07 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:47.978656 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f1ff48b5-d672-4ac9-b33a-e367e79bcf07 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:47.979197 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f1ff48b5-d672-4ac9-b33a-e367e79bcf07 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:47.979625 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f1ff48b5-d672-4ac9-b33a-e367e79bcf07 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:48.009958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-48845cec-267c-4d94-839d-2c18c6028f42 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:48.013758 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:31:48.020548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-48845cec-267c-4d94-839d-2c18c6028f42 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1675 microversion: 2.1 time: 0.159205 Aug 05 10:31:48.021114 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 366/715] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:47 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:48.061557 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-f1ff48b5-d672-4ac9-b33a-e367e79bcf07 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] HTTP exception thrown: Cannot 'detach_volume' instance 94bc927e-f379-4a93-a980-289f58af66f9 while it is in vm_state rescued Aug 05 10:31:48.063209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f1ff48b5-d672-4ac9-b33a-e367e79bcf07 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Request method failure captured: Aug 05 10:31:48.063209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: DELETE /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9/os-volume_attachments/aeb10a98-520c-494d-80ea-7cc61a200ff8 HTTP/1.1 Aug 05 10:31:48.063209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:31:48.063209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:31:48.063209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:31:48.063209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:31:48.063209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:31:48.063209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:31:48.063209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:31:48.063209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:31:48.063209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PBLDFW-X3TEawahF022LKFEKV68Ad6QHuGA8zjD7iptWxegCnn7NLZ93P_TTqy3qTfPaJgoXQW6RoMmhvpe8LOMj4ugeXgyBba8RW5T7FaRUqiQbD8fVKZKJ6l7h0zXL8SVOmIKhkBmKk6oIc4sQHq4LfBFKZWadDD9oZ1zaftUols Aug 05 10:31:48.063209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:31:48.063209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:31:48.063209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:31:48.063209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:31:48.063209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:31:48.063209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:31:48.063209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 9ea83951557a48fcaab832aea2273453 Aug 05 10:31:48.063209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-739497926 Aug 05 10:31:48.063209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:31:48.063209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:31:48.064787 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9ea83951557a48fcaab832aea2273453"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9ea83951557a48fcaab832aea2273453"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ea83951557a48fcaab832aea2273453"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ea83951557a48fcaab832aea2273453"}]}] Aug 05 10:31:48.064787 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-ServerRescueNegativeTestJSON-739497926 Aug 05 10:31:48.064787 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 9ea83951557a48fcaab832aea2273453 Aug 05 10:31:48.064787 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-739497926 Aug 05 10:31:48.064787 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-ServerRescueNegativeTestJSON-739497926-project Aug 05 10:31:48.064787 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:31:48.064787 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:31:48.064787 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: a3b4d90bcfc34d2d9ba1c40316e09858 Aug 05 10:31:48.064787 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-ServerRescueNegativeTestJSON-739497926-project Aug 05 10:31:48.064787 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: > Aug 05 10:31:48.064787 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Cannot 'detach_volume' instance 94bc927e-f379-4a93-a980-289f58af66f9 while it is in vm_state rescued Aug 05 10:31:48.065661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'server_id': '94bc927e-f379-4a93-a980-289f58af66f9', 'id': 'aeb10a98-520c-494d-80ea-7cc61a200ff8'} Aug 05 10:31:48.065661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:31:48.065661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:31:48.065661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 05 10:31:48.065661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 05 10:31:48.065661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 10:31:48.065661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 10:31:48.065661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 05 10:31:48.065661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 05 10:31:48.065661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 94bc927e-f379-4a93-a980-289f58af66f9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 05 10:31:48.065661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:31:48.065661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:31:48.065661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:31:48.065661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:31:48.065661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:31:48.065661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:31:48.065661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:31:48.065661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:31:48.065661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:31:48.065661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:31:48.067260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 05 10:31:48.067260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 05 10:31:48.067260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 05 10:31:48.067260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 05 10:31:48.067260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 94bc927e-f379-4a93-a980-289f58af66f9 while it is in vm_state rescued Aug 05 10:31:48.067260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:31:48.067260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:31:48.067260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:31:48.067260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:31:48.067260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:31:48.067260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:31:48.067260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:31:48.067260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:31:48.067260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 94bc927e-f379-4a93-a980-289f58af66f9 while it is in vm_state rescued Aug 05 10:31:48.067260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:31:48.067260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f1ff48b5-d672-4ac9-b33a-e367e79bcf07 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Returning 409 to user: Cannot 'detach_volume' instance 94bc927e-f379-4a93-a980-289f58af66f9 while it is in vm_state rescued {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:31:48.068613 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f1ff48b5-d672-4ac9-b33a-e367e79bcf07 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "DELETE /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9/os-volume_attachments/aeb10a98-520c-494d-80ea-7cc61a200ff8" status: 409 len: 152 microversion: 2.1 time: 0.097957 Aug 05 10:31:48.068613 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 350/716] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 5 10:31:47 2022] DELETE /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9/os-volume_attachments/aeb10a98-520c-494d-80ea-7cc61a200ff8 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 05 10:31:48.073582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6a4fd5f3-6897-48a6-8137-2e65f0f72480 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:31:48.074119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6a4fd5f3-6897-48a6-8137-2e65f0f72480 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:48.081156 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a4fd5f3-6897-48a6-8137-2e65f0f72480 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:48.081637 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a4fd5f3-6897-48a6-8137-2e65f0f72480 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:48.082068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a4fd5f3-6897-48a6-8137-2e65f0f72480 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:48.082767 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a4fd5f3-6897-48a6-8137-2e65f0f72480 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:48.083267 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a4fd5f3-6897-48a6-8137-2e65f0f72480 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:48.083691 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a4fd5f3-6897-48a6-8137-2e65f0f72480 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:48.154658 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6a4fd5f3-6897-48a6-8137-2e65f0f72480 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "POST /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9/action" status: 202 len: 0 microversion: 2.1 time: 0.084767 Aug 05 10:31:48.158605 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 367/717] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 10:31:48 2022] POST /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:31:48.165117 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-7677af57-a0a3-4521-a960-96b9cd699559 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:48.165729 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-7677af57-a0a3-4521-a960-96b9cd699559 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:48.173084 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7677af57-a0a3-4521-a960-96b9cd699559 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:48.173598 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7677af57-a0a3-4521-a960-96b9cd699559 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:48.174010 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7677af57-a0a3-4521-a960-96b9cd699559 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:48.174752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7677af57-a0a3-4521-a960-96b9cd699559 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:48.175204 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7677af57-a0a3-4521-a960-96b9cd699559 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:48.175620 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7677af57-a0a3-4521-a960-96b9cd699559 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:48.404150 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-7677af57-a0a3-4521-a960-96b9cd699559 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:48.412410 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-7677af57-a0a3-4521-a960-96b9cd699559 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1722 microversion: 2.1 time: 0.251161 Aug 05 10:31:48.412970 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 351/718] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:48 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:49.044875 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-015ea5d0-5003-4fad-a279-de7b62fefa43 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:49.045682 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-015ea5d0-5003-4fad-a279-de7b62fefa43 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:49.053525 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-015ea5d0-5003-4fad-a279-de7b62fefa43 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:49.054015 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-015ea5d0-5003-4fad-a279-de7b62fefa43 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:49.054526 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-015ea5d0-5003-4fad-a279-de7b62fefa43 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:49.055393 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-015ea5d0-5003-4fad-a279-de7b62fefa43 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:49.055922 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-015ea5d0-5003-4fad-a279-de7b62fefa43 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:49.056416 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-015ea5d0-5003-4fad-a279-de7b62fefa43 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:49.192458 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-015ea5d0-5003-4fad-a279-de7b62fefa43 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:49.202848 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-015ea5d0-5003-4fad-a279-de7b62fefa43 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1675 microversion: 2.1 time: 0.160935 Aug 05 10:31:49.203452 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 368/719] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:49 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:49.436064 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-3dcaccc6-997a-4ed5-a619-3ffa1875b1c0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:49.436678 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-3dcaccc6-997a-4ed5-a619-3ffa1875b1c0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:49.445468 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3dcaccc6-997a-4ed5-a619-3ffa1875b1c0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:49.446080 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3dcaccc6-997a-4ed5-a619-3ffa1875b1c0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:49.446624 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3dcaccc6-997a-4ed5-a619-3ffa1875b1c0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:49.447598 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3dcaccc6-997a-4ed5-a619-3ffa1875b1c0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:49.448195 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3dcaccc6-997a-4ed5-a619-3ffa1875b1c0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:49.448733 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3dcaccc6-997a-4ed5-a619-3ffa1875b1c0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:49.590211 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-3dcaccc6-997a-4ed5-a619-3ffa1875b1c0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:49.598639 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-3dcaccc6-997a-4ed5-a619-3ffa1875b1c0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1722 microversion: 2.1 time: 0.168112 Aug 05 10:31:49.599257 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 352/720] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:49 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:50.226208 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ebe0714a-2e12-41c8-831a-d1265a88600c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:50.226925 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ebe0714a-2e12-41c8-831a-d1265a88600c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:50.234048 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ebe0714a-2e12-41c8-831a-d1265a88600c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:50.234603 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ebe0714a-2e12-41c8-831a-d1265a88600c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:50.235072 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ebe0714a-2e12-41c8-831a-d1265a88600c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:50.235767 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ebe0714a-2e12-41c8-831a-d1265a88600c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:50.236212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ebe0714a-2e12-41c8-831a-d1265a88600c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:50.236625 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ebe0714a-2e12-41c8-831a-d1265a88600c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:50.369261 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ebe0714a-2e12-41c8-831a-d1265a88600c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:50.377058 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ebe0714a-2e12-41c8-831a-d1265a88600c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1675 microversion: 2.1 time: 0.154808 Aug 05 10:31:50.377629 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 369/721] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:50 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:50.621339 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-28f6df63-21b0-477b-8818-b1cfa589b24e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:50.622829 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-28f6df63-21b0-477b-8818-b1cfa589b24e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:50.633690 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-28f6df63-21b0-477b-8818-b1cfa589b24e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:50.634459 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-28f6df63-21b0-477b-8818-b1cfa589b24e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:50.635116 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-28f6df63-21b0-477b-8818-b1cfa589b24e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:50.636200 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-28f6df63-21b0-477b-8818-b1cfa589b24e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:50.636876 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-28f6df63-21b0-477b-8818-b1cfa589b24e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:50.637675 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-28f6df63-21b0-477b-8818-b1cfa589b24e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:50.789218 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-28f6df63-21b0-477b-8818-b1cfa589b24e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:50.798189 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-28f6df63-21b0-477b-8818-b1cfa589b24e tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1722 microversion: 2.1 time: 0.180800 Aug 05 10:31:50.798747 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 353/722] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:50 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:51.402876 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-88f18961-2a30-471c-9b41-467f8e06c13e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:51.404070 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-88f18961-2a30-471c-9b41-467f8e06c13e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:51.415264 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88f18961-2a30-471c-9b41-467f8e06c13e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:51.416059 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88f18961-2a30-471c-9b41-467f8e06c13e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:51.416771 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88f18961-2a30-471c-9b41-467f8e06c13e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:51.417914 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88f18961-2a30-471c-9b41-467f8e06c13e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:51.419004 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88f18961-2a30-471c-9b41-467f8e06c13e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:51.419435 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88f18961-2a30-471c-9b41-467f8e06c13e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:51.554571 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-88f18961-2a30-471c-9b41-467f8e06c13e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:51.562302 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-88f18961-2a30-471c-9b41-467f8e06c13e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1675 microversion: 2.1 time: 0.166908 Aug 05 10:31:51.562857 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 370/723] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:51 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:51.819539 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-9113f533-b123-4e91-add7-862a9f4865a1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:51.820150 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-9113f533-b123-4e91-add7-862a9f4865a1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:51.827299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9113f533-b123-4e91-add7-862a9f4865a1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:51.827778 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9113f533-b123-4e91-add7-862a9f4865a1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:51.828234 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9113f533-b123-4e91-add7-862a9f4865a1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:51.828927 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9113f533-b123-4e91-add7-862a9f4865a1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:51.829361 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9113f533-b123-4e91-add7-862a9f4865a1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:51.829764 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9113f533-b123-4e91-add7-862a9f4865a1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:51.963380 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-9113f533-b123-4e91-add7-862a9f4865a1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:51.972673 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-9113f533-b123-4e91-add7-862a9f4865a1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1722 microversion: 2.1 time: 0.156960 Aug 05 10:31:51.973250 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 354/724] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:51 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:52.586113 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-af9f05ec-de72-4f06-9e27-5183005412ff tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:52.586728 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-af9f05ec-de72-4f06-9e27-5183005412ff tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:52.595421 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-af9f05ec-de72-4f06-9e27-5183005412ff tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:52.595899 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-af9f05ec-de72-4f06-9e27-5183005412ff tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:52.596324 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-af9f05ec-de72-4f06-9e27-5183005412ff tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:52.597009 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-af9f05ec-de72-4f06-9e27-5183005412ff tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:52.597452 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-af9f05ec-de72-4f06-9e27-5183005412ff tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:52.597863 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-af9f05ec-de72-4f06-9e27-5183005412ff tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:52.740974 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-af9f05ec-de72-4f06-9e27-5183005412ff tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:52.752322 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-af9f05ec-de72-4f06-9e27-5183005412ff tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1675 microversion: 2.1 time: 0.171806 Aug 05 10:31:52.752857 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 371/725] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:52 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:53.000421 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-e1e7a013-436f-4f85-9313-c974347c4a93 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:53.001063 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-e1e7a013-436f-4f85-9313-c974347c4a93 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:53.008037 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e1e7a013-436f-4f85-9313-c974347c4a93 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:53.008524 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e1e7a013-436f-4f85-9313-c974347c4a93 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:53.008965 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e1e7a013-436f-4f85-9313-c974347c4a93 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:53.009675 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e1e7a013-436f-4f85-9313-c974347c4a93 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:53.010111 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e1e7a013-436f-4f85-9313-c974347c4a93 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:53.010560 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e1e7a013-436f-4f85-9313-c974347c4a93 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:53.149954 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e1e7a013-436f-4f85-9313-c974347c4a93 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:53.159348 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-e1e7a013-436f-4f85-9313-c974347c4a93 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1728 microversion: 2.1 time: 0.166201 Aug 05 10:31:53.160283 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 355/726] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:52 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:53.180388 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3b488b99-8b44-4af1-8f82-49c6a80ac3c4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:53.180885 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3b488b99-8b44-4af1-8f82-49c6a80ac3c4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:53.187559 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b488b99-8b44-4af1-8f82-49c6a80ac3c4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:53.188049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b488b99-8b44-4af1-8f82-49c6a80ac3c4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:53.188485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b488b99-8b44-4af1-8f82-49c6a80ac3c4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:53.189163 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b488b99-8b44-4af1-8f82-49c6a80ac3c4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:53.189676 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b488b99-8b44-4af1-8f82-49c6a80ac3c4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:53.190061 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b488b99-8b44-4af1-8f82-49c6a80ac3c4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:53.278638 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3b488b99-8b44-4af1-8f82-49c6a80ac3c4 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102120 Aug 05 10:31:53.279330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 372/727] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 5 10:31:53 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:31:53.774059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-30b01686-3b35-4802-9915-470366e6ff66 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:53.774768 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-30b01686-3b35-4802-9915-470366e6ff66 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:53.781384 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-30b01686-3b35-4802-9915-470366e6ff66 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:53.781873 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-30b01686-3b35-4802-9915-470366e6ff66 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:53.782305 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-30b01686-3b35-4802-9915-470366e6ff66 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:53.783031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-30b01686-3b35-4802-9915-470366e6ff66 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:53.783485 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-30b01686-3b35-4802-9915-470366e6ff66 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:53.783908 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-30b01686-3b35-4802-9915-470366e6ff66 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:53.922506 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-30b01686-3b35-4802-9915-470366e6ff66 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:53.930639 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-30b01686-3b35-4802-9915-470366e6ff66 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1675 microversion: 2.1 time: 0.160395 Aug 05 10:31:53.931263 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 356/728] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:53 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:54.460165 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-86ac91d3-e596-44e1-9991-e104887fb1c2 req-4cbcb272-b2fa-4c35-b112-6b964ad5ef38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94bc927e-f379-4a93-a980-289f58af66f9", "tag": "76d42f2f-ee41-465d-bac5-77d316e82d9d"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:31:54.469871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-86ac91d3-e596-44e1-9991-e104887fb1c2 req-4cbcb272-b2fa-4c35-b112-6b964ad5ef38 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:54.470336 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-86ac91d3-e596-44e1-9991-e104887fb1c2 req-4cbcb272-b2fa-4c35-b112-6b964ad5ef38 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:54.470748 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-86ac91d3-e596-44e1-9991-e104887fb1c2 req-4cbcb272-b2fa-4c35-b112-6b964ad5ef38 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:54.484377 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-86ac91d3-e596-44e1-9991-e104887fb1c2 req-4cbcb272-b2fa-4c35-b112-6b964ad5ef38 service nova] Creating event network-changed:76d42f2f-ee41-465d-bac5-77d316e82d9d for instance 94bc927e-f379-4a93-a980-289f58af66f9 on hv-cinder-81558 Aug 05 10:31:54.489346 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-86ac91d3-e596-44e1-9991-e104887fb1c2 req-4cbcb272-b2fa-4c35-b112-6b964ad5ef38 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100360 Aug 05 10:31:54.490164 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 373/729] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:31:54.952504 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-9ae04f42-72ee-48c8-a8b6-aada5d82ea57 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:54.953891 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-9ae04f42-72ee-48c8-a8b6-aada5d82ea57 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:54.960490 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9ae04f42-72ee-48c8-a8b6-aada5d82ea57 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:54.961294 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9ae04f42-72ee-48c8-a8b6-aada5d82ea57 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:54.961739 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9ae04f42-72ee-48c8-a8b6-aada5d82ea57 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:54.962449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9ae04f42-72ee-48c8-a8b6-aada5d82ea57 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:54.962932 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9ae04f42-72ee-48c8-a8b6-aada5d82ea57 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:54.963398 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9ae04f42-72ee-48c8-a8b6-aada5d82ea57 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:55.388260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-9ae04f42-72ee-48c8-a8b6-aada5d82ea57 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:55.399946 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-9ae04f42-72ee-48c8-a8b6-aada5d82ea57 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1675 microversion: 2.1 time: 0.451197 Aug 05 10:31:55.400774 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 357/730] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:54 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1675 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:56.429111 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-80a881bc-bf6a-4b81-b7a9-5789feb26563 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:56.430094 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-80a881bc-bf6a-4b81-b7a9-5789feb26563 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:56.440643 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-80a881bc-bf6a-4b81-b7a9-5789feb26563 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:56.441429 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-80a881bc-bf6a-4b81-b7a9-5789feb26563 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:56.442213 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-80a881bc-bf6a-4b81-b7a9-5789feb26563 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:56.443362 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-80a881bc-bf6a-4b81-b7a9-5789feb26563 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:56.444105 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-80a881bc-bf6a-4b81-b7a9-5789feb26563 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:56.444850 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-80a881bc-bf6a-4b81-b7a9-5789feb26563 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:56.519035 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-2b17e9cd-1824-4682-9214-f9d2410f2101 req-8da55b02-d81a-4e7e-91ff-75cf06d6f5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94bc927e-f379-4a93-a980-289f58af66f9", "tag": "76d42f2f-ee41-465d-bac5-77d316e82d9d"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:31:56.530121 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-2b17e9cd-1824-4682-9214-f9d2410f2101 req-8da55b02-d81a-4e7e-91ff-75cf06d6f5b2 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:56.530711 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-2b17e9cd-1824-4682-9214-f9d2410f2101 req-8da55b02-d81a-4e7e-91ff-75cf06d6f5b2 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:56.531176 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-2b17e9cd-1824-4682-9214-f9d2410f2101 req-8da55b02-d81a-4e7e-91ff-75cf06d6f5b2 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:56.543075 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-2b17e9cd-1824-4682-9214-f9d2410f2101 req-8da55b02-d81a-4e7e-91ff-75cf06d6f5b2 service nova] Creating event network-changed:76d42f2f-ee41-465d-bac5-77d316e82d9d for instance 94bc927e-f379-4a93-a980-289f58af66f9 on hv-cinder-81558 Aug 05 10:31:56.548523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-2b17e9cd-1824-4682-9214-f9d2410f2101 req-8da55b02-d81a-4e7e-91ff-75cf06d6f5b2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033158 Aug 05 10:31:56.549152 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 358/731] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:31:56.588781 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-80a881bc-bf6a-4b81-b7a9-5789feb26563 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:56.596897 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-80a881bc-bf6a-4b81-b7a9-5789feb26563 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1675 microversion: 2.1 time: 0.176317 Aug 05 10:31:56.597511 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 374/732] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:56 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:57.623835 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-fda15e61-f251-456f-b2db-4b6b2ab69b58 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:57.624646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-fda15e61-f251-456f-b2db-4b6b2ab69b58 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:57.631763 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fda15e61-f251-456f-b2db-4b6b2ab69b58 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:57.632248 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fda15e61-f251-456f-b2db-4b6b2ab69b58 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:57.632686 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fda15e61-f251-456f-b2db-4b6b2ab69b58 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:57.633387 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fda15e61-f251-456f-b2db-4b6b2ab69b58 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:57.633845 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fda15e61-f251-456f-b2db-4b6b2ab69b58 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:57.634271 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fda15e61-f251-456f-b2db-4b6b2ab69b58 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:57.793782 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-fda15e61-f251-456f-b2db-4b6b2ab69b58 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:57.802078 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-fda15e61-f251-456f-b2db-4b6b2ab69b58 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1675 microversion: 2.1 time: 0.185281 Aug 05 10:31:57.802643 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 359/733] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:57 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1675 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:31:58.827635 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a0b342b4-b3ba-4cd5-afc7-2951ad744a47 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:31:58.828247 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a0b342b4-b3ba-4cd5-afc7-2951ad744a47 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:31:58.836024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a0b342b4-b3ba-4cd5-afc7-2951ad744a47 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:58.836549 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a0b342b4-b3ba-4cd5-afc7-2951ad744a47 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:58.837020 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a0b342b4-b3ba-4cd5-afc7-2951ad744a47 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:58.837784 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a0b342b4-b3ba-4cd5-afc7-2951ad744a47 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:31:58.838269 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a0b342b4-b3ba-4cd5-afc7-2951ad744a47 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:31:58.838727 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a0b342b4-b3ba-4cd5-afc7-2951ad744a47 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:31:58.981412 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a0b342b4-b3ba-4cd5-afc7-2951ad744a47 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:31:58.989437 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a0b342b4-b3ba-4cd5-afc7-2951ad744a47 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1675 microversion: 2.1 time: 0.168044 Aug 05 10:31:58.990028 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 375/734] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:31:58 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:00.013599 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b200d866-2ce0-4014-bff6-9bd128d11373 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:00.014266 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b200d866-2ce0-4014-bff6-9bd128d11373 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:00.021622 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b200d866-2ce0-4014-bff6-9bd128d11373 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:00.022126 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b200d866-2ce0-4014-bff6-9bd128d11373 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:00.022576 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b200d866-2ce0-4014-bff6-9bd128d11373 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:00.023345 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b200d866-2ce0-4014-bff6-9bd128d11373 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:00.023847 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b200d866-2ce0-4014-bff6-9bd128d11373 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:00.024284 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b200d866-2ce0-4014-bff6-9bd128d11373 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:00.028918 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:32:00.158358 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b200d866-2ce0-4014-bff6-9bd128d11373 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:00.167991 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b200d866-2ce0-4014-bff6-9bd128d11373 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1675 microversion: 2.1 time: 0.158496 Aug 05 10:32:00.168751 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 360/735] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:00 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:01.190027 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3be0d3a9-b8cb-4904-b8d5-90a882c78e92 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:01.190651 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3be0d3a9-b8cb-4904-b8d5-90a882c78e92 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:01.198160 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3be0d3a9-b8cb-4904-b8d5-90a882c78e92 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:01.198643 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3be0d3a9-b8cb-4904-b8d5-90a882c78e92 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:01.199114 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3be0d3a9-b8cb-4904-b8d5-90a882c78e92 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:01.199813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3be0d3a9-b8cb-4904-b8d5-90a882c78e92 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:01.200264 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3be0d3a9-b8cb-4904-b8d5-90a882c78e92 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:01.200693 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3be0d3a9-b8cb-4904-b8d5-90a882c78e92 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:01.332719 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3be0d3a9-b8cb-4904-b8d5-90a882c78e92 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:01.340741 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3be0d3a9-b8cb-4904-b8d5-90a882c78e92 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1675 microversion: 2.1 time: 0.154729 Aug 05 10:32:01.341239 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 376/736] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:01 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:02.366369 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-8b7e1f0c-8ef3-4eca-8fe5-ee6241021d97 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:02.367420 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-8b7e1f0c-8ef3-4eca-8fe5-ee6241021d97 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:02.378517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8b7e1f0c-8ef3-4eca-8fe5-ee6241021d97 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:02.379369 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8b7e1f0c-8ef3-4eca-8fe5-ee6241021d97 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:02.380085 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8b7e1f0c-8ef3-4eca-8fe5-ee6241021d97 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:02.381160 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8b7e1f0c-8ef3-4eca-8fe5-ee6241021d97 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:02.381953 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8b7e1f0c-8ef3-4eca-8fe5-ee6241021d97 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:02.382648 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8b7e1f0c-8ef3-4eca-8fe5-ee6241021d97 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:02.540792 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-8b7e1f0c-8ef3-4eca-8fe5-ee6241021d97 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:02.550929 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-8b7e1f0c-8ef3-4eca-8fe5-ee6241021d97 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1675 microversion: 2.1 time: 0.191035 Aug 05 10:32:02.551545 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 361/737] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:02 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1675 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:03.583271 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cdfc07a9-fbad-40dd-bcdf-fda99df4356a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:03.584248 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cdfc07a9-fbad-40dd-bcdf-fda99df4356a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:03.594508 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdfc07a9-fbad-40dd-bcdf-fda99df4356a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:03.595031 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdfc07a9-fbad-40dd-bcdf-fda99df4356a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:03.595467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdfc07a9-fbad-40dd-bcdf-fda99df4356a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:03.596173 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdfc07a9-fbad-40dd-bcdf-fda99df4356a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:03.596630 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdfc07a9-fbad-40dd-bcdf-fda99df4356a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:03.597052 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdfc07a9-fbad-40dd-bcdf-fda99df4356a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:03.749355 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cdfc07a9-fbad-40dd-bcdf-fda99df4356a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:03.756924 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cdfc07a9-fbad-40dd-bcdf-fda99df4356a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1652 microversion: 2.1 time: 0.180391 Aug 05 10:32:03.757487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 377/738] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:03 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1652 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:03.779250 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-1fe4472a-3d94-4149-87bb-2e821226d94f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:32:03.786655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1fe4472a-3d94-4149-87bb-2e821226d94f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:03.787182 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1fe4472a-3d94-4149-87bb-2e821226d94f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:03.787617 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1fe4472a-3d94-4149-87bb-2e821226d94f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:03.810255 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-1fe4472a-3d94-4149-87bb-2e821226d94f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Going to try to start instance {{(pid=117831) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 05 10:32:03.856686 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-1fe4472a-3d94-4149-87bb-2e821226d94f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "POST /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a/action" status: 202 len: 0 microversion: 2.1 time: 0.081960 Aug 05 10:32:03.857131 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 362/739] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 10:32:03 2022] POST /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:32:03.866543 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c349ba31-d4b7-4dc6-b7ae-60f3b3d2c411 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:03.867193 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c349ba31-d4b7-4dc6-b7ae-60f3b3d2c411 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:03.873664 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c349ba31-d4b7-4dc6-b7ae-60f3b3d2c411 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:03.874188 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c349ba31-d4b7-4dc6-b7ae-60f3b3d2c411 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:03.874883 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c349ba31-d4b7-4dc6-b7ae-60f3b3d2c411 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:03.875447 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c349ba31-d4b7-4dc6-b7ae-60f3b3d2c411 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:03.875895 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c349ba31-d4b7-4dc6-b7ae-60f3b3d2c411 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:03.876317 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c349ba31-d4b7-4dc6-b7ae-60f3b3d2c411 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:04.010805 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c349ba31-d4b7-4dc6-b7ae-60f3b3d2c411 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:04.018738 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c349ba31-d4b7-4dc6-b7ae-60f3b3d2c411 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1661 microversion: 2.1 time: 0.156091 Aug 05 10:32:04.019347 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 378/740] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:03 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1661 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:05.045075 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-24e89356-c632-468d-9a03-d712ef628483 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:05.045727 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-24e89356-c632-468d-9a03-d712ef628483 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:05.055779 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-24e89356-c632-468d-9a03-d712ef628483 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:05.056412 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-24e89356-c632-468d-9a03-d712ef628483 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:05.057005 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-24e89356-c632-468d-9a03-d712ef628483 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:05.057808 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-24e89356-c632-468d-9a03-d712ef628483 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:05.058453 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-24e89356-c632-468d-9a03-d712ef628483 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:05.059029 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-24e89356-c632-468d-9a03-d712ef628483 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:05.209274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-24e89356-c632-468d-9a03-d712ef628483 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:05.217218 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-24e89356-c632-468d-9a03-d712ef628483 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1661 microversion: 2.1 time: 0.179457 Aug 05 10:32:05.217785 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 363/741] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:05 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1661 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:06.242476 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a081cf84-0df3-4d05-8a46-dc985954c377 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:06.243311 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a081cf84-0df3-4d05-8a46-dc985954c377 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:06.252777 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a081cf84-0df3-4d05-8a46-dc985954c377 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:06.253436 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a081cf84-0df3-4d05-8a46-dc985954c377 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:06.254038 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a081cf84-0df3-4d05-8a46-dc985954c377 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:06.255081 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a081cf84-0df3-4d05-8a46-dc985954c377 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:06.255692 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a081cf84-0df3-4d05-8a46-dc985954c377 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:06.256294 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a081cf84-0df3-4d05-8a46-dc985954c377 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:06.393734 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a081cf84-0df3-4d05-8a46-dc985954c377 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:06.402073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a081cf84-0df3-4d05-8a46-dc985954c377 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1665 microversion: 2.1 time: 0.165753 Aug 05 10:32:06.402644 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 379/742] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:06 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1665 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:06.495141 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-1167d278-924b-408d-82b7-fe6bb42b91f9 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:06.495668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-1167d278-924b-408d-82b7-fe6bb42b91f9 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:06.502174 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1167d278-924b-408d-82b7-fe6bb42b91f9 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:06.502648 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1167d278-924b-408d-82b7-fe6bb42b91f9 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:06.503149 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1167d278-924b-408d-82b7-fe6bb42b91f9 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:06.503834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1167d278-924b-408d-82b7-fe6bb42b91f9 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:06.504282 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1167d278-924b-408d-82b7-fe6bb42b91f9 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:06.504702 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1167d278-924b-408d-82b7-fe6bb42b91f9 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:06.527636 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-1167d278-924b-408d-82b7-fe6bb42b91f9 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3/ips" status: 200 len: 148 microversion: 2.1 time: 0.143729 Aug 05 10:32:06.528181 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 364/743] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 5 10:32:06 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3/ips => generated 148 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:32:06.541828 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5dba9a33-90bc-4740-9b10-8fc60f173762 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "843f4994-a0d7-44a6-b614-8977f3400e5e"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:32:06.545611 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5dba9a33-90bc-4740-9b10-8fc60f173762 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:06.555279 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5dba9a33-90bc-4740-9b10-8fc60f173762 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:06.556023 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5dba9a33-90bc-4740-9b10-8fc60f173762 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:06.556714 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5dba9a33-90bc-4740-9b10-8fc60f173762 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:06.557729 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5dba9a33-90bc-4740-9b10-8fc60f173762 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:06.558437 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5dba9a33-90bc-4740-9b10-8fc60f173762 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:06.559111 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5dba9a33-90bc-4740-9b10-8fc60f173762 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:06.640720 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-5dba9a33-90bc-4740-9b10-8fc60f173762 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] HTTP exception thrown: Invalid volume: volume 843f4994-a0d7-44a6-b614-8977f3400e5e is already attached to instances: cfcbf025-92b9-4b98-8819-7f9fb41dce79 Aug 05 10:32:06.642413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5dba9a33-90bc-4740-9b10-8fc60f173762 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Request method failure captured: Aug 05 10:32:06.642413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: POST /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3/os-volume_attachments HTTP/1.1 Aug 05 10:32:06.642413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:32:06.642413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:32:06.642413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:32:06.642413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 74 Aug 05 10:32:06.642413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:32:06.642413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:32:06.642413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:32:06.642413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:32:06.642413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PBEs4GBOTlzHHz3GlVMvlqYVRTPVr6yfrGm0EGFVS5M35LAWkuYfM80ilZKBHnEJ38Pfkbr8nmaDnAJrpi-BzlSuGmVoFSK8TlIqOxf92-vzFhtlF5ILOctbBpl6iN-xfLgYYmkabgjeYJKmgu_f_koSkZUI4fIkuVQ5_PFB3z056g Aug 05 10:32:06.642413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:32:06.642413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:32:06.642413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:32:06.642413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:32:06.642413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:32:06.642413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:32:06.642413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:32:06.642413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:32:06.642413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:32:06.642413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:32:06.644002 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_588c79a0604e49f49123980f0e9af63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}] Aug 05 10:32:06.644002 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:32:06.644002 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:32:06.644002 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:32:06.644002 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:32:06.644002 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:32:06.644002 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:32:06.644002 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: 706dbfa719c04fd0a3704ebd7eb812cd Aug 05 10:32:06.644002 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:32:06.644002 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Aug 05 10:32:06.644002 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {"volumeAttachment": {"volumeId": "843f4994-a0d7-44a6-b614-8977f3400e5e"}} Aug 05 10:32:06.644002 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:32:06.644761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Invalid volume: volume 843f4994-a0d7-44a6-b614-8977f3400e5e is already attached to instances: cfcbf025-92b9-4b98-8819-7f9fb41dce79 Aug 05 10:32:06.644761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'server_id': '7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3', 'body': {'volumeAttachment': {'volumeId': '843f4994-a0d7-44a6-b614-8977f3400e5e'}}} Aug 05 10:32:06.644761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:32:06.644761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:32:06.644761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 10:32:06.644761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 10:32:06.644761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 10:32:06.644761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 10:32:06.644761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 05 10:32:06.644761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 05 10:32:06.644761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 05 10:32:06.644761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 05 10:32:06.644761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 05 10:32:06.644761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 05 10:32:06.644761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 843f4994-a0d7-44a6-b614-8977f3400e5e is already attached to instances: cfcbf025-92b9-4b98-8819-7f9fb41dce79 Aug 05 10:32:06.644761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:32:06.644761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:32:06.644761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:32:06.644761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:32:06.645977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:32:06.645977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:32:06.645977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:32:06.645977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:32:06.645977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:32:06.645977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:32:06.645977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 10:32:06.645977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 10:32:06.645977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 10:32:06.645977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 10:32:06.645977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 10:32:06.645977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 10:32:06.645977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 05 10:32:06.645977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 05 10:32:06.645977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 843f4994-a0d7-44a6-b614-8977f3400e5e is already attached to instances: cfcbf025-92b9-4b98-8819-7f9fb41dce79 Aug 05 10:32:06.645977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:32:06.645977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:32:06.645977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:32:06.645977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:32:06.645977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:32:06.647176 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:32:06.647176 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:32:06.647176 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:32:06.647176 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 843f4994-a0d7-44a6-b614-8977f3400e5e is already attached to instances: cfcbf025-92b9-4b98-8819-7f9fb41dce79 Aug 05 10:32:06.647176 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:32:06.647176 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5dba9a33-90bc-4740-9b10-8fc60f173762 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Returning 400 to user: Invalid volume: volume 843f4994-a0d7-44a6-b614-8977f3400e5e is already attached to instances: cfcbf025-92b9-4b98-8819-7f9fb41dce79 {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:32:06.647176 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5dba9a33-90bc-4740-9b10-8fc60f173762 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "POST /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107971 Aug 05 10:32:06.647176 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 380/744] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 10:32:06 2022] POST /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 10:32:06.653570 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c673e46c-7cc8-4bc9-9230-4fc5d20b7238 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:06.654093 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c673e46c-7cc8-4bc9-9230-4fc5d20b7238 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:06.660530 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c673e46c-7cc8-4bc9-9230-4fc5d20b7238 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:06.661012 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c673e46c-7cc8-4bc9-9230-4fc5d20b7238 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:06.661444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c673e46c-7cc8-4bc9-9230-4fc5d20b7238 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:06.662126 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c673e46c-7cc8-4bc9-9230-4fc5d20b7238 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:06.662573 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c673e46c-7cc8-4bc9-9230-4fc5d20b7238 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:06.663025 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c673e46c-7cc8-4bc9-9230-4fc5d20b7238 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:06.688059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c673e46c-7cc8-4bc9-9230-4fc5d20b7238 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Going to try to terminate instance {{(pid=117831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 10:32:06.780467 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c673e46c-7cc8-4bc9-9230-4fc5d20b7238 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 204 len: 0 microversion: 2.1 time: 0.130746 Aug 05 10:32:06.781253 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 365/745] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:32:06 2022] DELETE /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:32:06.790118 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-df91a4d2-6d78-4028-b8d2-3b2f5ebc0e0d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:06.790728 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-df91a4d2-6d78-4028-b8d2-3b2f5ebc0e0d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:06.799677 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df91a4d2-6d78-4028-b8d2-3b2f5ebc0e0d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:06.800194 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df91a4d2-6d78-4028-b8d2-3b2f5ebc0e0d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:06.800670 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df91a4d2-6d78-4028-b8d2-3b2f5ebc0e0d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:06.801353 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df91a4d2-6d78-4028-b8d2-3b2f5ebc0e0d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:06.801809 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df91a4d2-6d78-4028-b8d2-3b2f5ebc0e0d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:06.802232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df91a4d2-6d78-4028-b8d2-3b2f5ebc0e0d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:06.942065 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-df91a4d2-6d78-4028-b8d2-3b2f5ebc0e0d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:06.950085 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-df91a4d2-6d78-4028-b8d2-3b2f5ebc0e0d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 200 len: 1681 microversion: 2.1 time: 0.164087 Aug 05 10:32:06.950849 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 381/746] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:06 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:07.976634 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-8155f028-e09c-45c1-8af0-83c74515f5dd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:07.977895 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-8155f028-e09c-45c1-8af0-83c74515f5dd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:07.988828 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8155f028-e09c-45c1-8af0-83c74515f5dd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:07.989677 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8155f028-e09c-45c1-8af0-83c74515f5dd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:07.990427 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8155f028-e09c-45c1-8af0-83c74515f5dd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:07.991655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8155f028-e09c-45c1-8af0-83c74515f5dd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:07.992479 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8155f028-e09c-45c1-8af0-83c74515f5dd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:07.993111 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8155f028-e09c-45c1-8af0-83c74515f5dd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:08.137061 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-8155f028-e09c-45c1-8af0-83c74515f5dd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:08.149557 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-8155f028-e09c-45c1-8af0-83c74515f5dd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 200 len: 1681 microversion: 2.1 time: 0.179932 Aug 05 10:32:08.150413 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 366/747] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:07 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:09.173229 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a9fdf0d7-e0d6-4ef9-8b42-81d75d69bb75 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:09.173834 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a9fdf0d7-e0d6-4ef9-8b42-81d75d69bb75 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:09.180591 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9fdf0d7-e0d6-4ef9-8b42-81d75d69bb75 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:09.181069 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9fdf0d7-e0d6-4ef9-8b42-81d75d69bb75 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:09.181495 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9fdf0d7-e0d6-4ef9-8b42-81d75d69bb75 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:09.182180 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9fdf0d7-e0d6-4ef9-8b42-81d75d69bb75 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:09.182624 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9fdf0d7-e0d6-4ef9-8b42-81d75d69bb75 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:09.183075 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9fdf0d7-e0d6-4ef9-8b42-81d75d69bb75 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:09.320016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a9fdf0d7-e0d6-4ef9-8b42-81d75d69bb75 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:09.328540 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a9fdf0d7-e0d6-4ef9-8b42-81d75d69bb75 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 200 len: 1681 microversion: 2.1 time: 0.159588 Aug 05 10:32:09.329113 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 382/748] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:09 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:09.969673 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-333e804e-02f0-4147-bf58-cd3551e835ad req-0be2ba68-685b-4aed-a4ee-5519a69c4926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3", "name": "network-vif-deleted", "tag": "fe9efa99-2628-4877-9bb9-0064315a40ca"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:32:09.974742 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:32:09.981077 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-333e804e-02f0-4147-bf58-cd3551e835ad req-0be2ba68-685b-4aed-a4ee-5519a69c4926 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:09.981549 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-333e804e-02f0-4147-bf58-cd3551e835ad req-0be2ba68-685b-4aed-a4ee-5519a69c4926 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:09.981967 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-333e804e-02f0-4147-bf58-cd3551e835ad req-0be2ba68-685b-4aed-a4ee-5519a69c4926 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:09.996207 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-333e804e-02f0-4147-bf58-cd3551e835ad req-0be2ba68-685b-4aed-a4ee-5519a69c4926 service nova] Creating event network-vif-deleted:fe9efa99-2628-4877-9bb9-0064315a40ca for instance 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 on hv-cinder-81558 Aug 05 10:32:10.001998 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-333e804e-02f0-4147-bf58-cd3551e835ad req-0be2ba68-685b-4aed-a4ee-5519a69c4926 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098418 Aug 05 10:32:10.002623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 367/749] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:32:10.350008 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3cb1e652-ef00-44b1-a75e-3ad7b041fbb6 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:10.350560 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3cb1e652-ef00-44b1-a75e-3ad7b041fbb6 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:10.357561 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3cb1e652-ef00-44b1-a75e-3ad7b041fbb6 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:10.358134 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3cb1e652-ef00-44b1-a75e-3ad7b041fbb6 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:10.358597 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3cb1e652-ef00-44b1-a75e-3ad7b041fbb6 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:10.359447 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3cb1e652-ef00-44b1-a75e-3ad7b041fbb6 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:10.360035 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3cb1e652-ef00-44b1-a75e-3ad7b041fbb6 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:10.360477 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3cb1e652-ef00-44b1-a75e-3ad7b041fbb6 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:10.381286 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:32:10.398209 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3cb1e652-ef00-44b1-a75e-3ad7b041fbb6 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:10.398695 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3cb1e652-ef00-44b1-a75e-3ad7b041fbb6 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:10.399156 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3cb1e652-ef00-44b1-a75e-3ad7b041fbb6 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:10.399608 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-3cb1e652-ef00-44b1-a75e-3ad7b041fbb6 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lazy-loading 'fault' on Instance uuid 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:32:10.445255 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3cb1e652-ef00-44b1-a75e-3ad7b041fbb6 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:10.453985 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3cb1e652-ef00-44b1-a75e-3ad7b041fbb6 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 200 len: 1332 microversion: 2.1 time: 0.107921 Aug 05 10:32:10.458951 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 383/750] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:10 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:11.481331 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-02fc5d4c-786c-45ab-9091-3d2808e3a855 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:11.482359 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-02fc5d4c-786c-45ab-9091-3d2808e3a855 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:11.489435 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02fc5d4c-786c-45ab-9091-3d2808e3a855 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:11.489919 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02fc5d4c-786c-45ab-9091-3d2808e3a855 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:11.490349 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02fc5d4c-786c-45ab-9091-3d2808e3a855 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:11.491078 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02fc5d4c-786c-45ab-9091-3d2808e3a855 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:11.491527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02fc5d4c-786c-45ab-9091-3d2808e3a855 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:11.491945 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02fc5d4c-786c-45ab-9091-3d2808e3a855 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:11.507194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-02fc5d4c-786c-45ab-9091-3d2808e3a855 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] HTTP exception thrown: Instance 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 could not be found. Aug 05 10:32:11.508799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-02fc5d4c-786c-45ab-9091-3d2808e3a855 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Request method failure captured: Aug 05 10:32:11.508799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 HTTP/1.1 Aug 05 10:32:11.508799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:32:11.508799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:32:11.508799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:32:11.508799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:32:11.508799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:32:11.508799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:32:11.508799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:32:11.508799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:32:11.508799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PBEs4GBOTlzHHz3GlVMvlqYVRTPVr6yfrGm0EGFVS5M35LAWkuYfM80ilZKBHnEJ38Pfkbr8nmaDnAJrpi-BzlSuGmVoFSK8TlIqOxf92-vzFhtlF5ILOctbBpl6iN-xfLgYYmkabgjeYJKmgu_f_koSkZUI4fIkuVQ5_PFB3z056g Aug 05 10:32:11.508799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:32:11.508799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:32:11.508799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:32:11.508799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:32:11.508799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:32:11.508799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:32:11.508799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:32:11.508799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:32:11.508799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:32:11.508799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:32:11.510299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_588c79a0604e49f49123980f0e9af63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}] Aug 05 10:32:11.510299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:32:11.510299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:32:11.510299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:32:11.510299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:32:11.510299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:32:11.510299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:32:11.510299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: 706dbfa719c04fd0a3704ebd7eb812cd Aug 05 10:32:11.510299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:32:11.510299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: > Aug 05 10:32:11.510299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Instance 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 could not be found. Aug 05 10:32:11.510299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'id': '7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3'} Aug 05 10:32:11.511142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:32:11.511142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:32:11.511142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:32:11.511142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:32:11.511142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:32:11.511142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:32:11.511142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:32:11.511142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:32:11.511142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:32:11.511142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:32:11.511142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 could not be found. Aug 05 10:32:11.511142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:32:11.511142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:32:11.511142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:32:11.511142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:32:11.511142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:32:11.511142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:32:11.511142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:32:11.511142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:32:11.511142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:32:11.512373 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:32:11.512373 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:32:11.512373 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:32:11.512373 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:32:11.512373 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:32:11.512373 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:32:11.512373 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:32:11.512373 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 could not be found. Aug 05 10:32:11.512373 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:32:11.512373 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:32:11.512373 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:32:11.512373 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:32:11.512373 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:32:11.512373 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:32:11.512373 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:32:11.512373 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:32:11.512373 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 could not be found. Aug 05 10:32:11.512373 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:32:11.513444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-02fc5d4c-786c-45ab-9091-3d2808e3a855 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Returning 404 to user: Instance 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:32:11.513444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-02fc5d4c-786c-45ab-9091-3d2808e3a855 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 404 len: 111 microversion: 2.1 time: 0.036812 Aug 05 10:32:11.513444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 368/751] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:11 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:32:11.519291 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-59a29004-1f35-4f09-853c-e1a459d4d339 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '.version_select at 0x7f732758a9d0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:11.544749 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-59a29004-1f35-4f09-853c-e1a459d4d339 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1921313331" status: 202 len: 0 microversion: 2.1 time: 0.029279 Aug 05 10:32:11.545613 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 384/752] 10.222.0.40 () {58 vars in 1221 bytes} [Fri Aug 5 10:32:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1921313331 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 10:32:12.245363 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-588323c6-0c93-4921-9a4e-7041d899b891 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:12.246066 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-588323c6-0c93-4921-9a4e-7041d899b891 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:12.256627 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-588323c6-0c93-4921-9a4e-7041d899b891 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:12.257232 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-588323c6-0c93-4921-9a4e-7041d899b891 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:12.257766 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-588323c6-0c93-4921-9a4e-7041d899b891 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:12.258879 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-588323c6-0c93-4921-9a4e-7041d899b891 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:12.259659 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-588323c6-0c93-4921-9a4e-7041d899b891 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:12.260314 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-588323c6-0c93-4921-9a4e-7041d899b891 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:12.341869 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.objects.instance [None req-588323c6-0c93-4921-9a4e-7041d899b891 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lazy-loading 'services' on Instance uuid cfcbf025-92b9-4b98-8819-7f9fb41dce79 {{(pid=117831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:32:12.419376 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-588323c6-0c93-4921-9a4e-7041d899b891 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79/os-volume_attachments/843f4994-a0d7-44a6-b614-8977f3400e5e" status: 202 len: 0 microversion: 2.1 time: 0.180180 Aug 05 10:32:12.420165 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 369/753] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 5 10:32:12 2022] DELETE /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79/os-volume_attachments/843f4994-a0d7-44a6-b614-8977f3400e5e => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:32:12.429251 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-15b47c5f-d607-40c9-bed9-ce6a0b53ad11 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:12.431790 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-15b47c5f-d607-40c9-bed9-ce6a0b53ad11 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:12.433309 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:32:12.439473 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-15b47c5f-d607-40c9-bed9-ce6a0b53ad11 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:12.439959 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-15b47c5f-d607-40c9-bed9-ce6a0b53ad11 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:12.440425 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-15b47c5f-d607-40c9-bed9-ce6a0b53ad11 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:12.441236 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-15b47c5f-d607-40c9-bed9-ce6a0b53ad11 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:12.441764 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-15b47c5f-d607-40c9-bed9-ce6a0b53ad11 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:12.442263 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-15b47c5f-d607-40c9-bed9-ce6a0b53ad11 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:12.485407 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-15b47c5f-d607-40c9-bed9-ce6a0b53ad11 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060131 Aug 05 10:32:12.485973 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 385/754] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 10:32:12 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:32:13.502371 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-cd8e1109-7131-4e77-9425-a3bd8251df2a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:13.504750 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-cd8e1109-7131-4e77-9425-a3bd8251df2a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:13.511614 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cd8e1109-7131-4e77-9425-a3bd8251df2a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:13.512095 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cd8e1109-7131-4e77-9425-a3bd8251df2a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:13.512524 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cd8e1109-7131-4e77-9425-a3bd8251df2a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:13.513207 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cd8e1109-7131-4e77-9425-a3bd8251df2a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:13.513653 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cd8e1109-7131-4e77-9425-a3bd8251df2a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:13.514073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cd8e1109-7131-4e77-9425-a3bd8251df2a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:13.544886 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-cd8e1109-7131-4e77-9425-a3bd8251df2a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048869 Aug 05 10:32:13.545428 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 370/755] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 10:32:13 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:32:14.561677 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-11c0c41a-6bbf-4533-9774-a5ed70e15cc7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:14.565343 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-11c0c41a-6bbf-4533-9774-a5ed70e15cc7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:14.576326 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11c0c41a-6bbf-4533-9774-a5ed70e15cc7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:14.577118 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11c0c41a-6bbf-4533-9774-a5ed70e15cc7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:14.577834 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11c0c41a-6bbf-4533-9774-a5ed70e15cc7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:14.578938 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11c0c41a-6bbf-4533-9774-a5ed70e15cc7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:14.579556 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11c0c41a-6bbf-4533-9774-a5ed70e15cc7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:14.580049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11c0c41a-6bbf-4533-9774-a5ed70e15cc7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:14.608532 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-11c0c41a-6bbf-4533-9774-a5ed70e15cc7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053545 Aug 05 10:32:14.609326 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 386/756] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 10:32:14 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 10:32:14.673740 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f48775fa-f804-4474-be0c-077697cddb93 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:14.674271 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f48775fa-f804-4474-be0c-077697cddb93 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:14.681005 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f48775fa-f804-4474-be0c-077697cddb93 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:14.681487 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f48775fa-f804-4474-be0c-077697cddb93 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:14.681919 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f48775fa-f804-4474-be0c-077697cddb93 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:14.682603 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f48775fa-f804-4474-be0c-077697cddb93 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:14.683083 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f48775fa-f804-4474-be0c-077697cddb93 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:14.683476 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f48775fa-f804-4474-be0c-077697cddb93 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:14.709701 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f48775fa-f804-4474-be0c-077697cddb93 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Going to try to terminate instance {{(pid=117831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 10:32:14.805732 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f48775fa-f804-4474-be0c-077697cddb93 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 204 len: 0 microversion: 2.1 time: 0.135760 Aug 05 10:32:14.806287 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 371/757] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:32:14 2022] DELETE /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:32:14.815455 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-baf9876b-10c7-4961-8be9-a512dadb1e01 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:14.815994 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-baf9876b-10c7-4961-8be9-a512dadb1e01 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:14.822005 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-baf9876b-10c7-4961-8be9-a512dadb1e01 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:14.822484 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-baf9876b-10c7-4961-8be9-a512dadb1e01 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:14.822961 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-baf9876b-10c7-4961-8be9-a512dadb1e01 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:14.823634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-baf9876b-10c7-4961-8be9-a512dadb1e01 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:14.824082 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-baf9876b-10c7-4961-8be9-a512dadb1e01 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:14.824500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-baf9876b-10c7-4961-8be9-a512dadb1e01 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:14.962667 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-baf9876b-10c7-4961-8be9-a512dadb1e01 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:14.971362 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-baf9876b-10c7-4961-8be9-a512dadb1e01 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1682 microversion: 2.1 time: 0.160647 Aug 05 10:32:14.971923 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 387/758] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:14 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:15.993589 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b13e96b7-d40f-40a2-844b-a74a6cf16793 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:15.994578 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b13e96b7-d40f-40a2-844b-a74a6cf16793 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:16.001772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b13e96b7-d40f-40a2-844b-a74a6cf16793 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:16.002255 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b13e96b7-d40f-40a2-844b-a74a6cf16793 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:16.002696 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b13e96b7-d40f-40a2-844b-a74a6cf16793 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:16.003418 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b13e96b7-d40f-40a2-844b-a74a6cf16793 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:16.003837 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b13e96b7-d40f-40a2-844b-a74a6cf16793 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:16.004289 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b13e96b7-d40f-40a2-844b-a74a6cf16793 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:16.140667 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b13e96b7-d40f-40a2-844b-a74a6cf16793 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:16.148506 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b13e96b7-d40f-40a2-844b-a74a6cf16793 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1682 microversion: 2.1 time: 0.159728 Aug 05 10:32:16.149049 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 372/759] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:15 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:17.170056 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fc9949d2-0ea0-4c9d-980a-663706bc9e85 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:17.170636 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fc9949d2-0ea0-4c9d-980a-663706bc9e85 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:17.183253 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc9949d2-0ea0-4c9d-980a-663706bc9e85 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:17.183732 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc9949d2-0ea0-4c9d-980a-663706bc9e85 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:17.184165 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc9949d2-0ea0-4c9d-980a-663706bc9e85 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:17.185626 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc9949d2-0ea0-4c9d-980a-663706bc9e85 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:17.186128 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc9949d2-0ea0-4c9d-980a-663706bc9e85 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:17.186529 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc9949d2-0ea0-4c9d-980a-663706bc9e85 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:17.259289 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fc9949d2-0ea0-4c9d-980a-663706bc9e85 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:17.267351 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fc9949d2-0ea0-4c9d-980a-663706bc9e85 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 200 len: 1614 microversion: 2.1 time: 0.101264 Aug 05 10:32:17.281513 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 388/760] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:17 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 1614 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:17.282209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-f1c9d87a-84b8-458c-9994-4552c051f1ca req-ed5cafae-1d2c-4984-ba8f-f1b849ee6b72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfcbf025-92b9-4b98-8819-7f9fb41dce79", "name": "network-vif-deleted", "tag": "d4746dc0-741a-473e-b9a5-dd97a9ff2872"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:32:17.284090 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-f1c9d87a-84b8-458c-9994-4552c051f1ca req-ed5cafae-1d2c-4984-ba8f-f1b849ee6b72 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:17.284584 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-f1c9d87a-84b8-458c-9994-4552c051f1ca req-ed5cafae-1d2c-4984-ba8f-f1b849ee6b72 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:17.285149 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-f1c9d87a-84b8-458c-9994-4552c051f1ca req-ed5cafae-1d2c-4984-ba8f-f1b849ee6b72 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:17.297435 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-f1c9d87a-84b8-458c-9994-4552c051f1ca req-ed5cafae-1d2c-4984-ba8f-f1b849ee6b72 service nova] Creating event network-vif-deleted:d4746dc0-741a-473e-b9a5-dd97a9ff2872 for instance cfcbf025-92b9-4b98-8819-7f9fb41dce79 on hv-cinder-81558 Aug 05 10:32:17.303112 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-f1c9d87a-84b8-458c-9994-4552c051f1ca req-ed5cafae-1d2c-4984-ba8f-f1b849ee6b72 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032990 Aug 05 10:32:17.303713 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 373/761] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:32:18.290106 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bc690fe8-04f6-47dc-b4b2-824fd1be5276 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:18.290731 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bc690fe8-04f6-47dc-b4b2-824fd1be5276 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:18.297365 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc690fe8-04f6-47dc-b4b2-824fd1be5276 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:18.297831 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc690fe8-04f6-47dc-b4b2-824fd1be5276 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:18.298258 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc690fe8-04f6-47dc-b4b2-824fd1be5276 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:18.298934 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc690fe8-04f6-47dc-b4b2-824fd1be5276 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:18.299719 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc690fe8-04f6-47dc-b4b2-824fd1be5276 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:18.300048 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc690fe8-04f6-47dc-b4b2-824fd1be5276 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:18.315512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-bc690fe8-04f6-47dc-b4b2-824fd1be5276 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] HTTP exception thrown: Instance cfcbf025-92b9-4b98-8819-7f9fb41dce79 could not be found. Aug 05 10:32:18.317252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bc690fe8-04f6-47dc-b4b2-824fd1be5276 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Request method failure captured: Aug 05 10:32:18.317252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 HTTP/1.1 Aug 05 10:32:18.317252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:32:18.317252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:32:18.317252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:32:18.317252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:32:18.317252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:32:18.317252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:32:18.317252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:32:18.317252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:32:18.317252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PBEs4GBOTlzHHz3GlVMvlqYVRTPVr6yfrGm0EGFVS5M35LAWkuYfM80ilZKBHnEJ38Pfkbr8nmaDnAJrpi-BzlSuGmVoFSK8TlIqOxf92-vzFhtlF5ILOctbBpl6iN-xfLgYYmkabgjeYJKmgu_f_koSkZUI4fIkuVQ5_PFB3z056g Aug 05 10:32:18.317252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:32:18.317252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:32:18.317252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:32:18.317252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:32:18.317252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:32:18.317252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:32:18.317252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:32:18.317252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:32:18.317252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:32:18.317252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:32:18.318720 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_588c79a0604e49f49123980f0e9af63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}] Aug 05 10:32:18.318720 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:32:18.318720 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:32:18.318720 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:32:18.318720 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:32:18.318720 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:32:18.318720 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:32:18.318720 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: 706dbfa719c04fd0a3704ebd7eb812cd Aug 05 10:32:18.318720 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:32:18.318720 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:32:18.318720 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Instance cfcbf025-92b9-4b98-8819-7f9fb41dce79 could not be found. Aug 05 10:32:18.318720 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': 'cfcbf025-92b9-4b98-8819-7f9fb41dce79'} Aug 05 10:32:18.319573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:32:18.319573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:32:18.319573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:32:18.319573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:32:18.319573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:32:18.319573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:32:18.319573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:32:18.319573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:32:18.319573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:32:18.319573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:32:18.319573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfcbf025-92b9-4b98-8819-7f9fb41dce79 could not be found. Aug 05 10:32:18.319573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:32:18.319573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:32:18.319573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:32:18.319573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:32:18.319573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:32:18.319573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:32:18.319573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:32:18.319573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:32:18.319573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:32:18.321241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:32:18.321241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:32:18.321241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:32:18.321241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:32:18.321241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:32:18.321241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:32:18.321241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:32:18.321241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfcbf025-92b9-4b98-8819-7f9fb41dce79 could not be found. Aug 05 10:32:18.321241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:32:18.321241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:32:18.321241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:32:18.321241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:32:18.321241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:32:18.321241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:32:18.321241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:32:18.321241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:32:18.321241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfcbf025-92b9-4b98-8819-7f9fb41dce79 could not be found. Aug 05 10:32:18.321241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:32:18.322823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bc690fe8-04f6-47dc-b4b2-824fd1be5276 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Returning 404 to user: Instance cfcbf025-92b9-4b98-8819-7f9fb41dce79 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:32:18.322823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bc690fe8-04f6-47dc-b4b2-824fd1be5276 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 404 len: 111 microversion: 2.1 time: 0.032794 Aug 05 10:32:18.322823 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 389/762] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:18 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:32:18.331794 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-9488c2e3-0605-4c5a-a299-5849a11c5642 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '.version_select at 0x7f732fe0b0d0>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:18.353687 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-9488c2e3-0605-4c5a-a299-5849a11c5642 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-175890537" status: 202 len: 0 microversion: 2.1 time: 0.028816 Aug 05 10:32:18.354244 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 374/763] 10.222.0.40 () {58 vars in 1218 bytes} [Fri Aug 5 10:32:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-175890537 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:32:19.502173 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f412d333-dcca-43db-a542-39d3570af156 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Action: 'create', calling method: .version_select at 0x7f73276213a0>, body: {"keypair": {"name": "tempest-keypair-1069582400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMct6ycdHZOyv9ssFz3uB7P5y9uz8ijSW7GFLiCUZPfbq9hmkqyuVD02KfKo2y6cmx6lcJzAW4+FMKbKuk2cpfK98yVYH6qFE/8bTrpHRoHp597X85Am0z3wGTyhN1mURQ=="}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:32:19.520302 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-f412d333-dcca-43db-a542-39d3570af156 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Getting quotas for project 588c79a0604e49f49123980f0e9af63a. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:32:19.524414 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-f412d333-dcca-43db-a542-39d3570af156 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Getting quotas for user 706dbfa719c04fd0a3704ebd7eb812cd and project 588c79a0604e49f49123980f0e9af63a. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:32:19.551597 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f412d333-dcca-43db-a542-39d3570af156 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053209 Aug 05 10:32:19.552226 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 390/764] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 5 10:32:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:32:20.814981 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d5247dbe-8597-4615-8164-bcc079c8c032 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-17435031", "imageRef": "6163bb7c-dfd7-4fb1-a3cb-9f4818243f78", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "35d63aef-17c7-4ac5-9809-c80ac951c47d"}], "security_groups": [{"name": "tempest-securitygroup--1503210098"}], "key_name": "tempest-keypair-1069582400", "user_data": "}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:32:20.923503 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.network.neutron [None req-d5247dbe-8597-4615-8164-bcc079c8c032 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] validate_networks() for [('35d63aef-17c7-4ac5-9809-c80ac951c47d', None, None, None, None, None)] {{(pid=117831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 10:32:21.359925 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-d5247dbe-8597-4615-8164-bcc079c8c032 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Flavor limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 10:32:21.360524 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-d5247dbe-8597-4615-8164-bcc079c8c032 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Image limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 10:32:21.361323 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-d5247dbe-8597-4615-8164-bcc079c8c032 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Flavor pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 10:32:21.362161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-d5247dbe-8597-4615-8164-bcc079c8c032 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Image pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 10:32:21.362694 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-d5247dbe-8597-4615-8164-bcc079c8c032 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 10:32:21.376423 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d5247dbe-8597-4615-8164-bcc079c8c032 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:21.377230 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d5247dbe-8597-4615-8164-bcc079c8c032 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:21.377690 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d5247dbe-8597-4615-8164-bcc079c8c032 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:21.378505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d5247dbe-8597-4615-8164-bcc079c8c032 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:21.378965 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d5247dbe-8597-4615-8164-bcc079c8c032 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:21.379417 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d5247dbe-8597-4615-8164-bcc079c8c032 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:21.386650 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:32:21.399114 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-d5247dbe-8597-4615-8164-bcc079c8c032 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Getting quotas for project 588c79a0604e49f49123980f0e9af63a. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:32:21.403896 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-d5247dbe-8597-4615-8164-bcc079c8c032 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Getting quotas for user 706dbfa719c04fd0a3704ebd7eb812cd and project 588c79a0604e49f49123980f0e9af63a. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:32:21.415894 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d5247dbe-8597-4615-8164-bcc079c8c032 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Going to run 1 instances... {{(pid=117831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 10:32:21.418326 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d5247dbe-8597-4615-8164-bcc079c8c032 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6163bb7c-dfd7-4fb1-a3cb-9f4818243f78',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 10:32:21.467079 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d5247dbe-8597-4615-8164-bcc079c8c032 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.657043 Aug 05 10:32:21.467730 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 375/765] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 10:32:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 10:32:21.479509 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-944ff16b-5bc5-435c-bda2-9b27f8a0b9e8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:21.480143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-944ff16b-5bc5-435c-bda2-9b27f8a0b9e8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:21.535616 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-944ff16b-5bc5-435c-bda2-9b27f8a0b9e8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:21.542386 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-944ff16b-5bc5-435c-bda2-9b27f8a0b9e8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70" status: 200 len: 1240 microversion: 2.1 time: 0.067459 Aug 05 10:32:21.542969 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 391/766] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:21 2022] GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:22.567194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-46abb0aa-b486-48c1-ab4c-b17a1fd3532f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:22.568289 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-46abb0aa-b486-48c1-ab4c-b17a1fd3532f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:22.578400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-46abb0aa-b486-48c1-ab4c-b17a1fd3532f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:22.586610 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-46abb0aa-b486-48c1-ab4c-b17a1fd3532f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:22.586610 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-46abb0aa-b486-48c1-ab4c-b17a1fd3532f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:22.586610 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-46abb0aa-b486-48c1-ab4c-b17a1fd3532f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:22.586610 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-46abb0aa-b486-48c1-ab4c-b17a1fd3532f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:22.587021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-46abb0aa-b486-48c1-ab4c-b17a1fd3532f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:22.649192 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-46abb0aa-b486-48c1-ab4c-b17a1fd3532f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:22.657233 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-46abb0aa-b486-48c1-ab4c-b17a1fd3532f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70" status: 200 len: 1292 microversion: 2.1 time: 0.097027 Aug 05 10:32:22.657949 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 376/767] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:22 2022] GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70 => generated 1292 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:23.678423 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d3e68751-9e3f-4885-b317-e1ce9f5d9d21 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:23.679073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d3e68751-9e3f-4885-b317-e1ce9f5d9d21 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:23.686215 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3e68751-9e3f-4885-b317-e1ce9f5d9d21 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:23.686810 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3e68751-9e3f-4885-b317-e1ce9f5d9d21 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:23.687449 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3e68751-9e3f-4885-b317-e1ce9f5d9d21 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:23.688227 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3e68751-9e3f-4885-b317-e1ce9f5d9d21 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:23.688675 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3e68751-9e3f-4885-b317-e1ce9f5d9d21 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:23.689082 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3e68751-9e3f-4885-b317-e1ce9f5d9d21 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:23.826635 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d3e68751-9e3f-4885-b317-e1ce9f5d9d21 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:23.834532 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d3e68751-9e3f-4885-b317-e1ce9f5d9d21 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70" status: 200 len: 1366 microversion: 2.1 time: 0.160403 Aug 05 10:32:23.835127 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 392/768] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:23 2022] GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:24.271390 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-3e02096f-f0e1-470b-97f8-a1032bc91d88 req-238d6e25-fc6d-4ac5-b63f-bf37f25c79a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2ddd5d5-3966-4be6-a170-983dfa513c70", "tag": "2667c184-bc6e-43c8-b3af-9a09678ecf6d"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:32:24.283227 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-3e02096f-f0e1-470b-97f8-a1032bc91d88 req-238d6e25-fc6d-4ac5-b63f-bf37f25c79a0 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:24.283711 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-3e02096f-f0e1-470b-97f8-a1032bc91d88 req-238d6e25-fc6d-4ac5-b63f-bf37f25c79a0 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:24.284343 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-3e02096f-f0e1-470b-97f8-a1032bc91d88 req-238d6e25-fc6d-4ac5-b63f-bf37f25c79a0 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:24.296355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-3e02096f-f0e1-470b-97f8-a1032bc91d88 req-238d6e25-fc6d-4ac5-b63f-bf37f25c79a0 service nova] Creating event network-changed:2667c184-bc6e-43c8-b3af-9a09678ecf6d for instance a2ddd5d5-3966-4be6-a170-983dfa513c70 on hv-cinder-81558 Aug 05 10:32:24.301318 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-3e02096f-f0e1-470b-97f8-a1032bc91d88 req-238d6e25-fc6d-4ac5-b63f-bf37f25c79a0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033814 Aug 05 10:32:24.301921 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 377/769] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:32:24.858727 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7a23a156-96f7-4a46-afd7-08afe045a912 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:24.859404 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7a23a156-96f7-4a46-afd7-08afe045a912 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:24.867633 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a23a156-96f7-4a46-afd7-08afe045a912 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:24.868117 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a23a156-96f7-4a46-afd7-08afe045a912 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:24.868546 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a23a156-96f7-4a46-afd7-08afe045a912 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:24.869239 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a23a156-96f7-4a46-afd7-08afe045a912 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:24.869677 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a23a156-96f7-4a46-afd7-08afe045a912 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:24.870107 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a23a156-96f7-4a46-afd7-08afe045a912 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:25.011572 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7a23a156-96f7-4a46-afd7-08afe045a912 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:25.019529 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7a23a156-96f7-4a46-afd7-08afe045a912 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70" status: 200 len: 1366 microversion: 2.1 time: 0.166595 Aug 05 10:32:25.020089 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 393/770] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:24 2022] GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:26.046117 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d8baea4f-75b5-46d0-abe7-3fa9a559dc0d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:26.047298 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d8baea4f-75b5-46d0-abe7-3fa9a559dc0d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:26.058283 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d8baea4f-75b5-46d0-abe7-3fa9a559dc0d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:26.059160 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d8baea4f-75b5-46d0-abe7-3fa9a559dc0d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:26.059874 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d8baea4f-75b5-46d0-abe7-3fa9a559dc0d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:26.061008 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d8baea4f-75b5-46d0-abe7-3fa9a559dc0d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:26.061748 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d8baea4f-75b5-46d0-abe7-3fa9a559dc0d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:26.062446 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d8baea4f-75b5-46d0-abe7-3fa9a559dc0d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:26.199105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d8baea4f-75b5-46d0-abe7-3fa9a559dc0d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:26.209741 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d8baea4f-75b5-46d0-abe7-3fa9a559dc0d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70" status: 200 len: 1366 microversion: 2.1 time: 0.171128 Aug 05 10:32:26.210343 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 378/771] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:26 2022] GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:27.232445 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-396198c0-fab7-4999-855f-d7860c717b54 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:27.233038 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-396198c0-fab7-4999-855f-d7860c717b54 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:27.240750 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-396198c0-fab7-4999-855f-d7860c717b54 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:27.241227 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-396198c0-fab7-4999-855f-d7860c717b54 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:27.241653 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-396198c0-fab7-4999-855f-d7860c717b54 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:27.242335 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-396198c0-fab7-4999-855f-d7860c717b54 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:27.242780 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-396198c0-fab7-4999-855f-d7860c717b54 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:27.243230 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-396198c0-fab7-4999-855f-d7860c717b54 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:27.375956 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-396198c0-fab7-4999-855f-d7860c717b54 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:27.383941 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-396198c0-fab7-4999-855f-d7860c717b54 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70" status: 200 len: 1366 microversion: 2.1 time: 0.157590 Aug 05 10:32:27.384511 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 394/772] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:27 2022] GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:28.405538 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-6ab44633-574f-4744-9513-d9053bfd154a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:28.406117 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-6ab44633-574f-4744-9513-d9053bfd154a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:28.413207 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6ab44633-574f-4744-9513-d9053bfd154a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:28.413789 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6ab44633-574f-4744-9513-d9053bfd154a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:28.414260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6ab44633-574f-4744-9513-d9053bfd154a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:28.415116 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6ab44633-574f-4744-9513-d9053bfd154a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:28.415633 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6ab44633-574f-4744-9513-d9053bfd154a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:28.415991 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6ab44633-574f-4744-9513-d9053bfd154a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:28.553524 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-6ab44633-574f-4744-9513-d9053bfd154a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:28.561217 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-6ab44633-574f-4744-9513-d9053bfd154a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70" status: 200 len: 1366 microversion: 2.1 time: 0.160031 Aug 05 10:32:28.561784 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 379/773] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:28 2022] GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:29.581923 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d519bd18-8a94-4691-a6a9-92838beef47d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:29.582780 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d519bd18-8a94-4691-a6a9-92838beef47d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:29.590243 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d519bd18-8a94-4691-a6a9-92838beef47d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:29.590723 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d519bd18-8a94-4691-a6a9-92838beef47d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:29.591182 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d519bd18-8a94-4691-a6a9-92838beef47d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:29.591877 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d519bd18-8a94-4691-a6a9-92838beef47d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:29.592324 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d519bd18-8a94-4691-a6a9-92838beef47d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:29.592744 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d519bd18-8a94-4691-a6a9-92838beef47d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:29.726625 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d519bd18-8a94-4691-a6a9-92838beef47d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:29.730142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d23aa34a-9b54-4003-a1ba-737df7745a90 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-420058493"}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:32:29.730734 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d23aa34a-9b54-4003-a1ba-737df7745a90 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:29.734537 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d519bd18-8a94-4691-a6a9-92838beef47d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70" status: 200 len: 1366 microversion: 2.1 time: 0.156603 Aug 05 10:32:29.735142 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 395/774] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:29 2022] GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:29.737636 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d23aa34a-9b54-4003-a1ba-737df7745a90 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:29.738118 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d23aa34a-9b54-4003-a1ba-737df7745a90 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:29.738546 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d23aa34a-9b54-4003-a1ba-737df7745a90 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:29.739494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d23aa34a-9b54-4003-a1ba-737df7745a90 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:29.740217 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d23aa34a-9b54-4003-a1ba-737df7745a90 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:29.740623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d23aa34a-9b54-4003-a1ba-737df7745a90 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:29.874060 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.network.security_group_api [None req-d23aa34a-9b54-4003-a1ba-737df7745a90 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Removing security group 859e5cea-276e-479e-9104-ebfafd9628d3 from port 281bc44c-dd54-4a8e-b7a3-049f2bdcf803 Aug 05 10:32:30.215708 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d23aa34a-9b54-4003-a1ba-737df7745a90 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "POST /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc/action" status: 202 len: 0 microversion: 2.1 time: 0.489349 Aug 05 10:32:30.216416 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 380/775] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 10:32:29 2022] POST /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:32:30.224829 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-760b5afd-1ded-4159-a3a2-31b3e742ff54 req-127282e3-1e25-4d05-940b-b56b0f8a9d9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08e86ee6-2452-4827-aff1-651395a4a8dc", "tag": "281bc44c-dd54-4a8e-b7a3-049f2bdcf803"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:32:30.234470 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-760b5afd-1ded-4159-a3a2-31b3e742ff54 req-127282e3-1e25-4d05-940b-b56b0f8a9d9f service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:30.234937 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-760b5afd-1ded-4159-a3a2-31b3e742ff54 req-127282e3-1e25-4d05-940b-b56b0f8a9d9f service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:30.235380 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-760b5afd-1ded-4159-a3a2-31b3e742ff54 req-127282e3-1e25-4d05-940b-b56b0f8a9d9f service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:30.248041 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-760b5afd-1ded-4159-a3a2-31b3e742ff54 req-127282e3-1e25-4d05-940b-b56b0f8a9d9f service nova] Creating event network-changed:281bc44c-dd54-4a8e-b7a3-049f2bdcf803 for instance 08e86ee6-2452-4827-aff1-651395a4a8dc on hv-cinder-81558 Aug 05 10:32:30.253896 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-760b5afd-1ded-4159-a3a2-31b3e742ff54 req-127282e3-1e25-4d05-940b-b56b0f8a9d9f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032665 Aug 05 10:32:30.254859 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 396/776] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:32:30.757533 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-7c5721d7-f773-49bb-a752-eb9efedd4475 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:30.758735 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-7c5721d7-f773-49bb-a752-eb9efedd4475 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:30.765167 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7c5721d7-f773-49bb-a752-eb9efedd4475 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:30.765654 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7c5721d7-f773-49bb-a752-eb9efedd4475 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:30.766256 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7c5721d7-f773-49bb-a752-eb9efedd4475 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:30.767161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7c5721d7-f773-49bb-a752-eb9efedd4475 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:30.767841 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7c5721d7-f773-49bb-a752-eb9efedd4475 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:30.768585 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7c5721d7-f773-49bb-a752-eb9efedd4475 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:30.954695 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-7c5721d7-f773-49bb-a752-eb9efedd4475 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:30.985057 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-20507346-0143-47d7-a8ab-f75e80a68f10 req-cb1b6c6e-832d-43b2-921d-432e768b6bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ddd5d5-3966-4be6-a170-983dfa513c70", "name": "network-vif-plugged", "status": "completed", "tag": "2667c184-bc6e-43c8-b3af-9a09678ecf6d"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:32:30.990509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-7c5721d7-f773-49bb-a752-eb9efedd4475 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70" status: 200 len: 1366 microversion: 2.1 time: 0.238065 Aug 05 10:32:30.995969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 381/777] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:30 2022] GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:31.002372 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-20507346-0143-47d7-a8ab-f75e80a68f10 req-cb1b6c6e-832d-43b2-921d-432e768b6bb6 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:31.003230 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-20507346-0143-47d7-a8ab-f75e80a68f10 req-cb1b6c6e-832d-43b2-921d-432e768b6bb6 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:31.004247 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-20507346-0143-47d7-a8ab-f75e80a68f10 req-cb1b6c6e-832d-43b2-921d-432e768b6bb6 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:31.018755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-20507346-0143-47d7-a8ab-f75e80a68f10 req-cb1b6c6e-832d-43b2-921d-432e768b6bb6 service nova] Creating event network-vif-plugged:2667c184-bc6e-43c8-b3af-9a09678ecf6d for instance a2ddd5d5-3966-4be6-a170-983dfa513c70 on hv-cinder-81558 Aug 05 10:32:31.026054 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-20507346-0143-47d7-a8ab-f75e80a68f10 req-cb1b6c6e-832d-43b2-921d-432e768b6bb6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131384 Aug 05 10:32:31.027155 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 397/778] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:32:31.372363 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-7e041446-75c2-4b8c-94c8-1bfb86473991 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:31.372854 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-7e041446-75c2-4b8c-94c8-1bfb86473991 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:31.376000 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-b333a01d-06fc-41ea-91ed-0abc88d78d37 req-f98cb310-0636-43d3-ae34-f1361e69b949 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08e86ee6-2452-4827-aff1-651395a4a8dc", "tag": "281bc44c-dd54-4a8e-b7a3-049f2bdcf803"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:32:31.379509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7e041446-75c2-4b8c-94c8-1bfb86473991 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:31.379998 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7e041446-75c2-4b8c-94c8-1bfb86473991 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:31.380428 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7e041446-75c2-4b8c-94c8-1bfb86473991 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:31.381128 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7e041446-75c2-4b8c-94c8-1bfb86473991 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:31.381574 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7e041446-75c2-4b8c-94c8-1bfb86473991 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:31.381992 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7e041446-75c2-4b8c-94c8-1bfb86473991 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:31.386130 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=2 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:32:31.386286 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-b333a01d-06fc-41ea-91ed-0abc88d78d37 req-f98cb310-0636-43d3-ae34-f1361e69b949 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:31.386836 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-b333a01d-06fc-41ea-91ed-0abc88d78d37 req-f98cb310-0636-43d3-ae34-f1361e69b949 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:31.387365 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-b333a01d-06fc-41ea-91ed-0abc88d78d37 req-f98cb310-0636-43d3-ae34-f1361e69b949 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:31.399761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-b333a01d-06fc-41ea-91ed-0abc88d78d37 req-f98cb310-0636-43d3-ae34-f1361e69b949 service nova] Creating event network-changed:281bc44c-dd54-4a8e-b7a3-049f2bdcf803 for instance 08e86ee6-2452-4827-aff1-651395a4a8dc on hv-cinder-81558 Aug 05 10:32:31.406705 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-b333a01d-06fc-41ea-91ed-0abc88d78d37 req-f98cb310-0636-43d3-ae34-f1361e69b949 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034891 Aug 05 10:32:31.407436 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 398/779] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:32:31.413230 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=6 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:32:31.472075 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.objects.instance [None req-7e041446-75c2-4b8c-94c8-1bfb86473991 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lazy-loading 'services' on Instance uuid 08e86ee6-2452-4827-aff1-651395a4a8dc {{(pid=117831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:32:31.549583 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-7e041446-75c2-4b8c-94c8-1bfb86473991 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "DELETE /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc/os-volume_attachments/6dce2d6a-f7d6-48a3-ab45-ced42e95fb2a" status: 202 len: 0 microversion: 2.1 time: 0.181017 Aug 05 10:32:31.550173 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 382/780] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 5 10:32:31 2022] DELETE /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc/os-volume_attachments/6dce2d6a-f7d6-48a3-ab45-ced42e95fb2a => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:32:31.556062 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:32:31.560596 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0c62ccf8-1003-4e7f-bdd7-1ef89ffe61bc tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:31.563117 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0c62ccf8-1003-4e7f-bdd7-1ef89ffe61bc tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:31.570059 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c62ccf8-1003-4e7f-bdd7-1ef89ffe61bc tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:31.570931 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c62ccf8-1003-4e7f-bdd7-1ef89ffe61bc tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:31.571370 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c62ccf8-1003-4e7f-bdd7-1ef89ffe61bc tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:31.572064 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c62ccf8-1003-4e7f-bdd7-1ef89ffe61bc tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:31.572504 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c62ccf8-1003-4e7f-bdd7-1ef89ffe61bc tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:31.572919 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c62ccf8-1003-4e7f-bdd7-1ef89ffe61bc tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:31.602213 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0c62ccf8-1003-4e7f-bdd7-1ef89ffe61bc tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047031 Aug 05 10:32:31.602747 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 399/781] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 10:32:31 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:32:32.016184 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-a0fd4e1a-9a22-4519-862e-d38f4b0f2786 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:32.017042 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-a0fd4e1a-9a22-4519-862e-d38f4b0f2786 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:32.023944 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a0fd4e1a-9a22-4519-862e-d38f4b0f2786 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:32.024428 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a0fd4e1a-9a22-4519-862e-d38f4b0f2786 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:32.024857 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a0fd4e1a-9a22-4519-862e-d38f4b0f2786 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:32.026100 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a0fd4e1a-9a22-4519-862e-d38f4b0f2786 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:32.026555 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a0fd4e1a-9a22-4519-862e-d38f4b0f2786 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:32.027014 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a0fd4e1a-9a22-4519-862e-d38f4b0f2786 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:32.164197 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a0fd4e1a-9a22-4519-862e-d38f4b0f2786 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:32.172195 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-a0fd4e1a-9a22-4519-862e-d38f4b0f2786 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70" status: 200 len: 1366 microversion: 2.1 time: 0.160648 Aug 05 10:32:32.172774 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 383/782] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:32 2022] GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:32.621327 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-30af1bbf-55a6-416f-9e76-c28a49217cf3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:32.624247 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-30af1bbf-55a6-416f-9e76-c28a49217cf3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:32.633857 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30af1bbf-55a6-416f-9e76-c28a49217cf3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:32.634484 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30af1bbf-55a6-416f-9e76-c28a49217cf3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:32.635143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30af1bbf-55a6-416f-9e76-c28a49217cf3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:32.635928 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30af1bbf-55a6-416f-9e76-c28a49217cf3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:32.636428 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30af1bbf-55a6-416f-9e76-c28a49217cf3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:32.636808 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30af1bbf-55a6-416f-9e76-c28a49217cf3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:32.668493 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-30af1bbf-55a6-416f-9e76-c28a49217cf3 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055112 Aug 05 10:32:32.673128 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 400/783] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 10:32:32 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:32:32.790077 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-31ef1d89-5572-4884-b6f9-1dee7900727b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:32.790579 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-31ef1d89-5572-4884-b6f9-1dee7900727b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:32.797256 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-31ef1d89-5572-4884-b6f9-1dee7900727b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:32.797744 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-31ef1d89-5572-4884-b6f9-1dee7900727b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:32.798180 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-31ef1d89-5572-4884-b6f9-1dee7900727b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:32.798878 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-31ef1d89-5572-4884-b6f9-1dee7900727b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:32.799368 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-31ef1d89-5572-4884-b6f9-1dee7900727b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:32.799796 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-31ef1d89-5572-4884-b6f9-1dee7900727b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:32.830054 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-31ef1d89-5572-4884-b6f9-1dee7900727b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b/os-volume_attachments/d9765be7-4d9f-4cc1-a504-306e579b20a9" status: 200 len: 194 microversion: 2.20 time: 0.144537 Aug 05 10:32:32.830628 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 384/784] 10.222.0.40 () {60 vars in 1454 bytes} [Fri Aug 5 10:32:32 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b/os-volume_attachments/d9765be7-4d9f-4cc1-a504-306e579b20a9 => generated 194 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 10:32:32.902862 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b4c105d5-6934-45b4-9c6c-f893d0754ace tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:32.903320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b4c105d5-6934-45b4-9c6c-f893d0754ace tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:32.909451 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4c105d5-6934-45b4-9c6c-f893d0754ace tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:32.909933 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4c105d5-6934-45b4-9c6c-f893d0754ace tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:32.910364 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4c105d5-6934-45b4-9c6c-f893d0754ace tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:32.911095 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4c105d5-6934-45b4-9c6c-f893d0754ace tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:32.911513 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4c105d5-6934-45b4-9c6c-f893d0754ace tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:32.911933 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b4c105d5-6934-45b4-9c6c-f893d0754ace tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:33.036221 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-b4c105d5-6934-45b4-9c6c-f893d0754ace tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lazy-loading 'services' on Instance uuid af7c11c7-dddb-481d-9d57-af021c48e71b {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:32:33.171905 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b4c105d5-6934-45b4-9c6c-f893d0754ace tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "DELETE /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b/os-volume_attachments/d9765be7-4d9f-4cc1-a504-306e579b20a9" status: 202 len: 0 microversion: 2.20 time: 0.273188 Aug 05 10:32:33.172689 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 401/785] 10.222.0.40 () {60 vars in 1457 bytes} [Fri Aug 5 10:32:32 2022] DELETE /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b/os-volume_attachments/d9765be7-4d9f-4cc1-a504-306e579b20a9 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:32:33.182448 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c644570f-fd80-4977-9e57-01e19cfe283a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:33.184771 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c644570f-fd80-4977-9e57-01e19cfe283a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:33.191895 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c644570f-fd80-4977-9e57-01e19cfe283a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:33.192376 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c644570f-fd80-4977-9e57-01e19cfe283a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:33.192783 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c644570f-fd80-4977-9e57-01e19cfe283a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:33.193304 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2d6f32af-bbda-4313-a097-301ee4971764 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:33.193462 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c644570f-fd80-4977-9e57-01e19cfe283a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:33.193941 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c644570f-fd80-4977-9e57-01e19cfe283a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:33.194111 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2d6f32af-bbda-4313-a097-301ee4971764 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:33.194339 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c644570f-fd80-4977-9e57-01e19cfe283a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:33.200727 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d6f32af-bbda-4313-a097-301ee4971764 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:33.201228 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d6f32af-bbda-4313-a097-301ee4971764 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:33.201653 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d6f32af-bbda-4313-a097-301ee4971764 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:33.202308 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d6f32af-bbda-4313-a097-301ee4971764 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:33.202776 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d6f32af-bbda-4313-a097-301ee4971764 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:33.203279 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d6f32af-bbda-4313-a097-301ee4971764 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:33.225428 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c644570f-fd80-4977-9e57-01e19cfe283a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046868 Aug 05 10:32:33.226080 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 385/786] 10.222.0.40 () {60 vars in 1343 bytes} [Fri Aug 5 10:32:33 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 10:32:33.336211 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2d6f32af-bbda-4313-a097-301ee4971764 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:33.344284 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2d6f32af-bbda-4313-a097-301ee4971764 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70" status: 200 len: 1366 microversion: 2.1 time: 0.155187 Aug 05 10:32:33.345199 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 402/787] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:33 2022] GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:33.684205 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-e2de5415-5b6d-43c5-9ba2-ac866b548a15 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:33.686870 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-e2de5415-5b6d-43c5-9ba2-ac866b548a15 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:33.695481 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e2de5415-5b6d-43c5-9ba2-ac866b548a15 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:33.696075 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e2de5415-5b6d-43c5-9ba2-ac866b548a15 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:33.696605 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e2de5415-5b6d-43c5-9ba2-ac866b548a15 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:33.697460 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e2de5415-5b6d-43c5-9ba2-ac866b548a15 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:33.697997 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e2de5415-5b6d-43c5-9ba2-ac866b548a15 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:33.698531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e2de5415-5b6d-43c5-9ba2-ac866b548a15 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:33.729787 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-e2de5415-5b6d-43c5-9ba2-ac866b548a15 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051093 Aug 05 10:32:33.730331 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 386/788] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 10:32:33 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:32:34.238044 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-da488892-85a7-428e-8e62-962070616757 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:34.240259 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-da488892-85a7-428e-8e62-962070616757 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:34.247467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da488892-85a7-428e-8e62-962070616757 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:34.247953 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da488892-85a7-428e-8e62-962070616757 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:34.248383 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da488892-85a7-428e-8e62-962070616757 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:34.249082 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da488892-85a7-428e-8e62-962070616757 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:34.249536 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da488892-85a7-428e-8e62-962070616757 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:34.249954 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da488892-85a7-428e-8e62-962070616757 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:34.280373 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-da488892-85a7-428e-8e62-962070616757 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046320 Aug 05 10:32:34.280942 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 403/789] 10.222.0.40 () {60 vars in 1343 bytes} [Fri Aug 5 10:32:34 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 10:32:34.369334 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-90a722b2-6dac-4ed8-8498-00577a0489ca tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:34.369948 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-90a722b2-6dac-4ed8-8498-00577a0489ca tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:34.376575 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-90a722b2-6dac-4ed8-8498-00577a0489ca tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:34.377041 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-90a722b2-6dac-4ed8-8498-00577a0489ca tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:34.377493 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-90a722b2-6dac-4ed8-8498-00577a0489ca tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:34.378175 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-90a722b2-6dac-4ed8-8498-00577a0489ca tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:34.378623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-90a722b2-6dac-4ed8-8498-00577a0489ca tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:34.379068 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-90a722b2-6dac-4ed8-8498-00577a0489ca tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:34.509984 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-90a722b2-6dac-4ed8-8498-00577a0489ca tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:34.518264 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-90a722b2-6dac-4ed8-8498-00577a0489ca tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70" status: 200 len: 1556 microversion: 2.1 time: 0.154701 Aug 05 10:32:34.518829 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 387/790] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:34 2022] GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:34.539030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-68ca6b2b-24ab-4984-9b26-56f7c4dcff6c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:34.539508 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-68ca6b2b-24ab-4984-9b26-56f7c4dcff6c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:34.545890 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-68ca6b2b-24ab-4984-9b26-56f7c4dcff6c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:34.546358 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-68ca6b2b-24ab-4984-9b26-56f7c4dcff6c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:34.546781 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-68ca6b2b-24ab-4984-9b26-56f7c4dcff6c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:34.547486 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-68ca6b2b-24ab-4984-9b26-56f7c4dcff6c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:34.547929 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-68ca6b2b-24ab-4984-9b26-56f7c4dcff6c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:34.548340 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-68ca6b2b-24ab-4984-9b26-56f7c4dcff6c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:34.640150 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-68ca6b2b-24ab-4984-9b26-56f7c4dcff6c tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104719 Aug 05 10:32:34.640962 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 404/791] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 5 10:32:34 2022] GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:32:34.742093 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ce638abe-1c8a-4ff3-9e20-197e127525b0 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:34.744311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-ce638abe-1c8a-4ff3-9e20-197e127525b0 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:34.750747 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ce638abe-1c8a-4ff3-9e20-197e127525b0 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:34.751286 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ce638abe-1c8a-4ff3-9e20-197e127525b0 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:34.751723 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ce638abe-1c8a-4ff3-9e20-197e127525b0 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:34.752426 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ce638abe-1c8a-4ff3-9e20-197e127525b0 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:34.752847 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ce638abe-1c8a-4ff3-9e20-197e127525b0 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:34.753272 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ce638abe-1c8a-4ff3-9e20-197e127525b0 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:34.783930 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ce638abe-1c8a-4ff3-9e20-197e127525b0 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045885 Aug 05 10:32:34.784641 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 388/792] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 10:32:34 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:32:35.293066 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-991bddb2-30a7-4ade-8fff-1b99fecdacd1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:35.295620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-991bddb2-30a7-4ade-8fff-1b99fecdacd1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:35.302301 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-991bddb2-30a7-4ade-8fff-1b99fecdacd1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:35.302840 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-991bddb2-30a7-4ade-8fff-1b99fecdacd1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:35.303372 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-991bddb2-30a7-4ade-8fff-1b99fecdacd1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:35.304272 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-991bddb2-30a7-4ade-8fff-1b99fecdacd1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:35.304909 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-991bddb2-30a7-4ade-8fff-1b99fecdacd1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:35.305330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-991bddb2-30a7-4ade-8fff-1b99fecdacd1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:35.309869 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:32:35.340769 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-991bddb2-30a7-4ade-8fff-1b99fecdacd1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052296 Aug 05 10:32:35.341454 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 405/793] 10.222.0.40 () {60 vars in 1343 bytes} [Fri Aug 5 10:32:35 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 10:32:35.797108 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b617da68-a7bd-448f-8e67-083e95995ece tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:35.799638 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b617da68-a7bd-448f-8e67-083e95995ece tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:35.813246 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b617da68-a7bd-448f-8e67-083e95995ece tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:35.813741 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b617da68-a7bd-448f-8e67-083e95995ece tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:35.814174 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b617da68-a7bd-448f-8e67-083e95995ece tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:35.814862 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b617da68-a7bd-448f-8e67-083e95995ece tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:35.815351 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b617da68-a7bd-448f-8e67-083e95995ece tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:35.815751 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b617da68-a7bd-448f-8e67-083e95995ece tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:35.847228 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b617da68-a7bd-448f-8e67-083e95995ece tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053976 Aug 05 10:32:35.850961 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 389/794] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 10:32:35 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 10:32:35.851166 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-528615c9-f730-42c6-8a1f-13f345963228 req-d36c795d-8b2c-427b-81e4-4fc8d2354993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2ddd5d5-3966-4be6-a170-983dfa513c70", "tag": "2667c184-bc6e-43c8-b3af-9a09678ecf6d"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:32:35.858096 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-a1b3edea-3174-41c2-97de-deccc5433bb0 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:35.858947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-528615c9-f730-42c6-8a1f-13f345963228 req-d36c795d-8b2c-427b-81e4-4fc8d2354993 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:35.859094 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-a1b3edea-3174-41c2-97de-deccc5433bb0 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:35.859426 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-528615c9-f730-42c6-8a1f-13f345963228 req-d36c795d-8b2c-427b-81e4-4fc8d2354993 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:35.859852 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-528615c9-f730-42c6-8a1f-13f345963228 req-d36c795d-8b2c-427b-81e4-4fc8d2354993 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:35.866372 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a1b3edea-3174-41c2-97de-deccc5433bb0 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:35.866861 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a1b3edea-3174-41c2-97de-deccc5433bb0 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:35.867334 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a1b3edea-3174-41c2-97de-deccc5433bb0 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:35.868039 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a1b3edea-3174-41c2-97de-deccc5433bb0 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:35.868492 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a1b3edea-3174-41c2-97de-deccc5433bb0 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:35.868920 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a1b3edea-3174-41c2-97de-deccc5433bb0 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:35.871573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-528615c9-f730-42c6-8a1f-13f345963228 req-d36c795d-8b2c-427b-81e4-4fc8d2354993 service nova] Creating event network-changed:2667c184-bc6e-43c8-b3af-9a09678ecf6d for instance a2ddd5d5-3966-4be6-a170-983dfa513c70 on hv-cinder-81558 Aug 05 10:32:35.876698 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-528615c9-f730-42c6-8a1f-13f345963228 req-d36c795d-8b2c-427b-81e4-4fc8d2354993 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031475 Aug 05 10:32:35.877534 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 406/795] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:32:35.947843 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-a1b3edea-3174-41c2-97de-deccc5433bb0 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] HTTP exception thrown: Instance 08e86ee6-2452-4827-aff1-651395a4a8dc is not attached to volume 6dce2d6a-f7d6-48a3-ab45-ced42e95fb2a Aug 05 10:32:35.960449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-a1b3edea-3174-41c2-97de-deccc5433bb0 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Request method failure captured: Aug 05 10:32:35.960449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: DELETE /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc/os-volume_attachments/6dce2d6a-f7d6-48a3-ab45-ced42e95fb2a HTTP/1.1 Aug 05 10:32:35.960449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:32:35.960449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:32:35.960449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:32:35.960449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:32:35.960449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:32:35.960449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:32:35.960449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:32:35.960449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:32:35.960449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PCWnS9z5hqUGfLkE1KSXtvqT92sS463dMOz2zaG0r2AjqrKPKySfex1ViAk6KqdEA2B6q4vGHCHJ4PYywEbcy9yEdVL-kYxglecOyGsepNZinnWqg7YPvXjQIDp2sqqZosXD-frT9vYVRNOWksSI1bkpeioTj2gJsnRHEsWF-tfeZ8 Aug 05 10:32:35.960449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:32:35.960449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:32:35.960449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:32:35.960449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:32:35.960449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:32:35.960449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:32:35.960449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: db2897585ac048ae93df3e38d1437e6e Aug 05 10:32:35.960449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-TestMinimumBasicScenario-529667882 Aug 05 10:32:35.960449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:32:35.960449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:32:35.962245 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_db2897585ac048ae93df3e38d1437e6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/db2897585ac048ae93df3e38d1437e6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db2897585ac048ae93df3e38d1437e6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db2897585ac048ae93df3e38d1437e6e"}]}] Aug 05 10:32:35.962245 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-TestMinimumBasicScenario-529667882 Aug 05 10:32:35.962245 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: db2897585ac048ae93df3e38d1437e6e Aug 05 10:32:35.962245 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-TestMinimumBasicScenario-529667882 Aug 05 10:32:35.962245 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-TestMinimumBasicScenario-529667882-project Aug 05 10:32:35.962245 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:32:35.962245 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:32:35.962245 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: 9697af06b1104425aed6692ba4f29238 Aug 05 10:32:35.962245 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-TestMinimumBasicScenario-529667882-project Aug 05 10:32:35.962245 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: > Aug 05 10:32:35.962245 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Instance 08e86ee6-2452-4827-aff1-651395a4a8dc is not attached to volume 6dce2d6a-f7d6-48a3-ab45-ced42e95fb2a Aug 05 10:32:35.963209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'server_id': '08e86ee6-2452-4827-aff1-651395a4a8dc', 'id': '6dce2d6a-f7d6-48a3-ab45-ced42e95fb2a'} Aug 05 10:32:35.963209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:32:35.963209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:32:35.963209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 05 10:32:35.963209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 05 10:32:35.963209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 10:32:35.963209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 10:32:35.963209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 05 10:32:35.963209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 05 10:32:35.963209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6dce2d6a-f7d6-48a3-ab45-ced42e95fb2a. Aug 05 10:32:35.963209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:32:35.963209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:32:35.963209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:32:35.963209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:32:35.963209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:32:35.963209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:32:35.963209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:32:35.963209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:32:35.963209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:32:35.964477 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:32:35.964477 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 05 10:32:35.964477 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 05 10:32:35.964477 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08e86ee6-2452-4827-aff1-651395a4a8dc is not attached to volume 6dce2d6a-f7d6-48a3-ab45-ced42e95fb2a Aug 05 10:32:35.964477 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:32:35.964477 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:32:35.964477 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:32:35.964477 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:32:35.964477 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:32:35.964477 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:32:35.964477 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:32:35.964477 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:32:35.964477 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08e86ee6-2452-4827-aff1-651395a4a8dc is not attached to volume 6dce2d6a-f7d6-48a3-ab45-ced42e95fb2a Aug 05 10:32:35.964477 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:32:35.964477 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-a1b3edea-3174-41c2-97de-deccc5433bb0 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Returning 404 to user: Instance 08e86ee6-2452-4827-aff1-651395a4a8dc is not attached to volume 6dce2d6a-f7d6-48a3-ab45-ced42e95fb2a {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:32:35.965452 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-a1b3edea-3174-41c2-97de-deccc5433bb0 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "DELETE /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc/os-volume_attachments/6dce2d6a-f7d6-48a3-ab45-ced42e95fb2a" status: 404 len: 154 microversion: 2.1 time: 0.107899 Aug 05 10:32:35.968292 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 390/796] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 5 10:32:35 2022] DELETE /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc/os-volume_attachments/6dce2d6a-f7d6-48a3-ab45-ced42e95fb2a => generated 154 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 10:32:36.355437 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-90be8060-f204-4348-a6ca-57e21e47ebaf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:36.358526 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-90be8060-f204-4348-a6ca-57e21e47ebaf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:36.364887 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90be8060-f204-4348-a6ca-57e21e47ebaf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:36.365720 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90be8060-f204-4348-a6ca-57e21e47ebaf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:36.366467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90be8060-f204-4348-a6ca-57e21e47ebaf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:36.367774 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90be8060-f204-4348-a6ca-57e21e47ebaf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:36.368429 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90be8060-f204-4348-a6ca-57e21e47ebaf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:36.369068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90be8060-f204-4348-a6ca-57e21e47ebaf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:36.402017 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-90be8060-f204-4348-a6ca-57e21e47ebaf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051976 Aug 05 10:32:36.403331 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 407/797] 10.222.0.40 () {60 vars in 1343 bytes} [Fri Aug 5 10:32:36 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:36.475868 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c5e276c1-6a45-4f1f-9cbb-5d35d920b73b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:36.476659 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c5e276c1-6a45-4f1f-9cbb-5d35d920b73b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:36.484155 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c5e276c1-6a45-4f1f-9cbb-5d35d920b73b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:36.484959 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c5e276c1-6a45-4f1f-9cbb-5d35d920b73b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:36.485699 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c5e276c1-6a45-4f1f-9cbb-5d35d920b73b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:36.486485 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c5e276c1-6a45-4f1f-9cbb-5d35d920b73b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:36.487030 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c5e276c1-6a45-4f1f-9cbb-5d35d920b73b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:36.487593 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c5e276c1-6a45-4f1f-9cbb-5d35d920b73b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:36.684813 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c5e276c1-6a45-4f1f-9cbb-5d35d920b73b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Going to try to terminate instance {{(pid=117831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 10:32:36.721805 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:32:36.793432 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c5e276c1-6a45-4f1f-9cbb-5d35d920b73b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "DELETE /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 204 len: 0 microversion: 2.20 time: 0.322630 Aug 05 10:32:36.794094 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 391/798] 10.222.0.40 () {60 vars in 1280 bytes} [Fri Aug 5 10:32:36 2022] DELETE /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 10:32:36.802465 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-030b2604-b7c1-438a-b689-285a3ffd468e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:36.803094 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-030b2604-b7c1-438a-b689-285a3ffd468e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:36.809496 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-030b2604-b7c1-438a-b689-285a3ffd468e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:36.809979 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-030b2604-b7c1-438a-b689-285a3ffd468e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:36.810407 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-030b2604-b7c1-438a-b689-285a3ffd468e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:36.811138 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-030b2604-b7c1-438a-b689-285a3ffd468e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:36.811580 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-030b2604-b7c1-438a-b689-285a3ffd468e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:36.811990 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-030b2604-b7c1-438a-b689-285a3ffd468e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:36.954977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-030b2604-b7c1-438a-b689-285a3ffd468e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:36.963427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-030b2604-b7c1-438a-b689-285a3ffd468e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:36.964902 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-030b2604-b7c1-438a-b689-285a3ffd468e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:36.966037 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-030b2604-b7c1-438a-b689-285a3ffd468e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1724 microversion: 2.20 time: 0.167685 Aug 05 10:32:36.966585 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 408/799] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:32:36 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:32:37.140033 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c1b13c17-32d9-474d-8cf4-314765aae7ce tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:37.140633 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c1b13c17-32d9-474d-8cf4-314765aae7ce tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:37.150049 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c1b13c17-32d9-474d-8cf4-314765aae7ce tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:37.150888 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c1b13c17-32d9-474d-8cf4-314765aae7ce tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:37.151811 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c1b13c17-32d9-474d-8cf4-314765aae7ce tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:37.152529 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c1b13c17-32d9-474d-8cf4-314765aae7ce tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:37.152966 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c1b13c17-32d9-474d-8cf4-314765aae7ce tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:37.153406 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c1b13c17-32d9-474d-8cf4-314765aae7ce tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:37.179715 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c1b13c17-32d9-474d-8cf4-314765aae7ce tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Going to try to terminate instance {{(pid=117831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 10:32:37.284003 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c1b13c17-32d9-474d-8cf4-314765aae7ce tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "DELETE /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 204 len: 0 microversion: 2.1 time: 0.149795 Aug 05 10:32:37.284662 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 392/800] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:32:37 2022] DELETE /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:32:37.294830 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c29c6b94-0bda-4e99-8d66-4e3f74d6ea05 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:37.295696 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c29c6b94-0bda-4e99-8d66-4e3f74d6ea05 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:37.303192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c29c6b94-0bda-4e99-8d66-4e3f74d6ea05 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:37.303748 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c29c6b94-0bda-4e99-8d66-4e3f74d6ea05 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:37.304206 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c29c6b94-0bda-4e99-8d66-4e3f74d6ea05 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:37.305262 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c29c6b94-0bda-4e99-8d66-4e3f74d6ea05 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:37.305732 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c29c6b94-0bda-4e99-8d66-4e3f74d6ea05 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:37.306152 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c29c6b94-0bda-4e99-8d66-4e3f74d6ea05 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:37.467682 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c29c6b94-0bda-4e99-8d66-4e3f74d6ea05 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:37.479266 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c29c6b94-0bda-4e99-8d66-4e3f74d6ea05 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1553 microversion: 2.1 time: 0.188050 Aug 05 10:32:37.479990 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 409/801] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:37 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1553 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:37.996992 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-2a8aa28e-de8b-4a97-8dd8-89541774c1c5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:37.998424 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-2a8aa28e-de8b-4a97-8dd8-89541774c1c5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:38.008474 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2a8aa28e-de8b-4a97-8dd8-89541774c1c5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:38.008960 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2a8aa28e-de8b-4a97-8dd8-89541774c1c5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:38.009397 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2a8aa28e-de8b-4a97-8dd8-89541774c1c5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:38.010088 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2a8aa28e-de8b-4a97-8dd8-89541774c1c5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:38.010540 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2a8aa28e-de8b-4a97-8dd8-89541774c1c5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:38.010985 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2a8aa28e-de8b-4a97-8dd8-89541774c1c5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:38.152882 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2a8aa28e-de8b-4a97-8dd8-89541774c1c5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:38.161129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2a8aa28e-de8b-4a97-8dd8-89541774c1c5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:38.162642 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2a8aa28e-de8b-4a97-8dd8-89541774c1c5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:38.163941 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-2a8aa28e-de8b-4a97-8dd8-89541774c1c5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1724 microversion: 2.20 time: 0.174852 Aug 05 10:32:38.164522 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 393/802] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:32:37 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:32:38.505054 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-da82f80e-32a6-409c-8921-cdc53d4f3712 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:38.506150 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-da82f80e-32a6-409c-8921-cdc53d4f3712 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:38.513945 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da82f80e-32a6-409c-8921-cdc53d4f3712 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:38.514422 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da82f80e-32a6-409c-8921-cdc53d4f3712 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:38.514851 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da82f80e-32a6-409c-8921-cdc53d4f3712 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:38.515579 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da82f80e-32a6-409c-8921-cdc53d4f3712 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:38.516027 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da82f80e-32a6-409c-8921-cdc53d4f3712 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:38.516445 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da82f80e-32a6-409c-8921-cdc53d4f3712 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:38.652001 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-da82f80e-32a6-409c-8921-cdc53d4f3712 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:38.664876 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-da82f80e-32a6-409c-8921-cdc53d4f3712 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1553 microversion: 2.1 time: 0.165112 Aug 05 10:32:38.665483 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 410/803] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:38 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:39.190763 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-a0a44542-b8d6-4bea-a7fb-ac51deb6704a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:39.191664 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-a0a44542-b8d6-4bea-a7fb-ac51deb6704a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:39.199471 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a0a44542-b8d6-4bea-a7fb-ac51deb6704a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:39.199950 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a0a44542-b8d6-4bea-a7fb-ac51deb6704a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:39.200379 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a0a44542-b8d6-4bea-a7fb-ac51deb6704a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:39.201069 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a0a44542-b8d6-4bea-a7fb-ac51deb6704a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:39.201523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a0a44542-b8d6-4bea-a7fb-ac51deb6704a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:39.201933 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a0a44542-b8d6-4bea-a7fb-ac51deb6704a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:39.344046 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a0a44542-b8d6-4bea-a7fb-ac51deb6704a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:39.354767 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a0a44542-b8d6-4bea-a7fb-ac51deb6704a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:39.356277 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a0a44542-b8d6-4bea-a7fb-ac51deb6704a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:39.357438 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-a0a44542-b8d6-4bea-a7fb-ac51deb6704a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1724 microversion: 2.20 time: 0.173261 Aug 05 10:32:39.357977 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 394/804] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:32:39 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:32:39.690159 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4f1c7f75-1205-41f4-9891-75e9ee219924 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:39.691191 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4f1c7f75-1205-41f4-9891-75e9ee219924 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:39.702483 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f1c7f75-1205-41f4-9891-75e9ee219924 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:39.703346 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f1c7f75-1205-41f4-9891-75e9ee219924 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:39.704062 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f1c7f75-1205-41f4-9891-75e9ee219924 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:39.705179 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f1c7f75-1205-41f4-9891-75e9ee219924 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:39.705915 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f1c7f75-1205-41f4-9891-75e9ee219924 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:39.706596 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f1c7f75-1205-41f4-9891-75e9ee219924 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:39.842966 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4f1c7f75-1205-41f4-9891-75e9ee219924 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:39.855409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4f1c7f75-1205-41f4-9891-75e9ee219924 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1553 microversion: 2.1 time: 0.171574 Aug 05 10:32:39.856176 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 411/805] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:39 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:40.384887 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-12e56b20-b437-4cc3-8e04-33fb5297ef8f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:40.385836 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-12e56b20-b437-4cc3-8e04-33fb5297ef8f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:40.396505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-12e56b20-b437-4cc3-8e04-33fb5297ef8f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:40.397371 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-12e56b20-b437-4cc3-8e04-33fb5297ef8f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:40.397911 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-12e56b20-b437-4cc3-8e04-33fb5297ef8f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:40.398467 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-12e56b20-b437-4cc3-8e04-33fb5297ef8f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:40.398938 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-12e56b20-b437-4cc3-8e04-33fb5297ef8f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:40.399363 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-12e56b20-b437-4cc3-8e04-33fb5297ef8f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:40.702874 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-12e56b20-b437-4cc3-8e04-33fb5297ef8f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:40.711707 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-12e56b20-b437-4cc3-8e04-33fb5297ef8f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:40.713183 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-12e56b20-b437-4cc3-8e04-33fb5297ef8f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:40.714484 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-12e56b20-b437-4cc3-8e04-33fb5297ef8f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1724 microversion: 2.20 time: 0.336343 Aug 05 10:32:40.715208 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 395/806] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:32:40 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1724 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:32:40.880546 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-35719e3c-7311-496c-9704-9dfce438f719 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:40.881182 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-35719e3c-7311-496c-9704-9dfce438f719 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:40.887852 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-35719e3c-7311-496c-9704-9dfce438f719 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:40.888333 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-35719e3c-7311-496c-9704-9dfce438f719 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:40.888768 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-35719e3c-7311-496c-9704-9dfce438f719 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:40.889459 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-35719e3c-7311-496c-9704-9dfce438f719 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:40.889905 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-35719e3c-7311-496c-9704-9dfce438f719 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:40.890323 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-35719e3c-7311-496c-9704-9dfce438f719 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:41.035155 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-35719e3c-7311-496c-9704-9dfce438f719 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9697af06b1104425aed6692ba4f29238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2897585ac048ae93df3e38d1437e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:41.042810 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-35719e3c-7311-496c-9704-9dfce438f719 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 200 len: 1553 microversion: 2.1 time: 0.166222 Aug 05 10:32:41.043419 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 412/807] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:40 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:41.407405 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-60bb1999-f5d1-482c-b93b-d5ca5bd2b446 req-10c68a4e-22e2-4f4e-a373-33ec3e2b0529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e86ee6-2452-4827-aff1-651395a4a8dc", "name": "network-vif-deleted", "tag": "281bc44c-dd54-4a8e-b7a3-049f2bdcf803"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:32:41.421029 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-60bb1999-f5d1-482c-b93b-d5ca5bd2b446 req-10c68a4e-22e2-4f4e-a373-33ec3e2b0529 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:41.422625 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-60bb1999-f5d1-482c-b93b-d5ca5bd2b446 req-10c68a4e-22e2-4f4e-a373-33ec3e2b0529 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:41.423125 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-60bb1999-f5d1-482c-b93b-d5ca5bd2b446 req-10c68a4e-22e2-4f4e-a373-33ec3e2b0529 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:41.436060 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-60bb1999-f5d1-482c-b93b-d5ca5bd2b446 req-10c68a4e-22e2-4f4e-a373-33ec3e2b0529 service nova] Creating event network-vif-deleted:281bc44c-dd54-4a8e-b7a3-049f2bdcf803 for instance 08e86ee6-2452-4827-aff1-651395a4a8dc on hv-cinder-81558 Aug 05 10:32:41.443296 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-60bb1999-f5d1-482c-b93b-d5ca5bd2b446 req-10c68a4e-22e2-4f4e-a373-33ec3e2b0529 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040724 Aug 05 10:32:41.444834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 396/808] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:32:41.737987 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a3e83213-51c4-4650-819a-920b696bb7bf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:41.738857 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a3e83213-51c4-4650-819a-920b696bb7bf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:41.745199 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3e83213-51c4-4650-819a-920b696bb7bf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:41.745675 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3e83213-51c4-4650-819a-920b696bb7bf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:41.746101 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3e83213-51c4-4650-819a-920b696bb7bf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:41.746789 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3e83213-51c4-4650-819a-920b696bb7bf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:41.747477 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3e83213-51c4-4650-819a-920b696bb7bf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:41.748177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3e83213-51c4-4650-819a-920b696bb7bf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:41.831898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a3e83213-51c4-4650-819a-920b696bb7bf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:41.842718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a3e83213-51c4-4650-819a-920b696bb7bf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:41.844526 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a3e83213-51c4-4650-819a-920b696bb7bf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:41.845704 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a3e83213-51c4-4650-819a-920b696bb7bf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 200 len: 1656 microversion: 2.20 time: 0.111932 Aug 05 10:32:41.846762 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 413/809] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:32:41 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 1656 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:32:42.064440 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-96d97ffb-a664-4afb-af95-be763b21da08 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:42.065133 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-96d97ffb-a664-4afb-af95-be763b21da08 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] [instance: 08e86ee6-2452-4827-aff1-651395a4a8dc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:42.067333 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:32:42.073096 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-96d97ffb-a664-4afb-af95-be763b21da08 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:42.073571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-96d97ffb-a664-4afb-af95-be763b21da08 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:42.073999 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-96d97ffb-a664-4afb-af95-be763b21da08 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:42.074688 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-96d97ffb-a664-4afb-af95-be763b21da08 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:42.075158 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-96d97ffb-a664-4afb-af95-be763b21da08 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:42.075576 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-96d97ffb-a664-4afb-af95-be763b21da08 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:42.094081 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-96d97ffb-a664-4afb-af95-be763b21da08 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] HTTP exception thrown: Instance 08e86ee6-2452-4827-aff1-651395a4a8dc could not be found. Aug 05 10:32:42.095757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-96d97ffb-a664-4afb-af95-be763b21da08 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Request method failure captured: Aug 05 10:32:42.095757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc HTTP/1.1 Aug 05 10:32:42.095757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:32:42.095757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:32:42.095757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:32:42.095757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:32:42.095757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:32:42.095757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:32:42.095757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:32:42.095757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:32:42.095757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PCWnS9z5hqUGfLkE1KSXtvqT92sS463dMOz2zaG0r2AjqrKPKySfex1ViAk6KqdEA2B6q4vGHCHJ4PYywEbcy9yEdVL-kYxglecOyGsepNZinnWqg7YPvXjQIDp2sqqZosXD-frT9vYVRNOWksSI1bkpeioTj2gJsnRHEsWF-tfeZ8 Aug 05 10:32:42.095757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:32:42.095757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:32:42.095757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:32:42.095757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:32:42.095757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:32:42.095757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:32:42.095757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: db2897585ac048ae93df3e38d1437e6e Aug 05 10:32:42.095757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-TestMinimumBasicScenario-529667882 Aug 05 10:32:42.095757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:32:42.095757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:32:42.097205 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_db2897585ac048ae93df3e38d1437e6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/db2897585ac048ae93df3e38d1437e6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db2897585ac048ae93df3e38d1437e6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db2897585ac048ae93df3e38d1437e6e"}]}] Aug 05 10:32:42.097205 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-TestMinimumBasicScenario-529667882 Aug 05 10:32:42.097205 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: db2897585ac048ae93df3e38d1437e6e Aug 05 10:32:42.097205 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-TestMinimumBasicScenario-529667882 Aug 05 10:32:42.097205 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-TestMinimumBasicScenario-529667882-project Aug 05 10:32:42.097205 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:32:42.097205 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:32:42.097205 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: 9697af06b1104425aed6692ba4f29238 Aug 05 10:32:42.097205 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-TestMinimumBasicScenario-529667882-project Aug 05 10:32:42.097205 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: > Aug 05 10:32:42.097205 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Instance 08e86ee6-2452-4827-aff1-651395a4a8dc could not be found. Aug 05 10:32:42.097205 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'id': '08e86ee6-2452-4827-aff1-651395a4a8dc'} Aug 05 10:32:42.098021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:32:42.098021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:32:42.098021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:32:42.098021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:32:42.098021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:32:42.098021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:32:42.098021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:32:42.098021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:32:42.098021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:32:42.098021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:32:42.098021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08e86ee6-2452-4827-aff1-651395a4a8dc could not be found. Aug 05 10:32:42.098021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:32:42.098021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:32:42.098021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:32:42.098021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:32:42.098021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:32:42.098021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:32:42.098021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:32:42.098021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:32:42.098021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:32:42.099224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:32:42.099224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:32:42.099224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:32:42.099224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:32:42.099224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:32:42.099224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:32:42.099224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:32:42.099224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08e86ee6-2452-4827-aff1-651395a4a8dc could not be found. Aug 05 10:32:42.099224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:32:42.099224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:32:42.099224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:32:42.099224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:32:42.099224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:32:42.099224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:32:42.099224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:32:42.099224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:32:42.099224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08e86ee6-2452-4827-aff1-651395a4a8dc could not be found. Aug 05 10:32:42.099224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:32:42.100409 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-96d97ffb-a664-4afb-af95-be763b21da08 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Returning 404 to user: Instance 08e86ee6-2452-4827-aff1-651395a4a8dc could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:32:42.100409 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-96d97ffb-a664-4afb-af95-be763b21da08 tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc" status: 404 len: 111 microversion: 2.1 time: 0.036974 Aug 05 10:32:42.100409 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 397/810] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:42 2022] GET /compute/v2.1/servers/08e86ee6-2452-4827-aff1-651395a4a8dc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:32:42.106537 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b83adb96-7af2-404a-aedd-65947cf7c09b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] Calling method '.version_select at 0x7f73274e3b80>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:42.126849 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b83adb96-7af2-404a-aedd-65947cf7c09b tempest-TestMinimumBasicScenario-529667882 tempest-TestMinimumBasicScenario-529667882-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-849845751" status: 202 len: 0 microversion: 2.1 time: 0.024020 Aug 05 10:32:42.127495 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 414/811] 10.222.0.40 () {58 vars in 1269 bytes} [Fri Aug 5 10:32:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-849845751 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:32:42.870446 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-31f94baa-7cc8-4d38-bfd7-df9ddfc5d53e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:42.871235 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-31f94baa-7cc8-4d38-bfd7-df9ddfc5d53e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:42.878038 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-31f94baa-7cc8-4d38-bfd7-df9ddfc5d53e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:42.878614 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-31f94baa-7cc8-4d38-bfd7-df9ddfc5d53e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:42.879088 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-31f94baa-7cc8-4d38-bfd7-df9ddfc5d53e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:42.879810 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-31f94baa-7cc8-4d38-bfd7-df9ddfc5d53e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:42.880262 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-31f94baa-7cc8-4d38-bfd7-df9ddfc5d53e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:42.880690 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-31f94baa-7cc8-4d38-bfd7-df9ddfc5d53e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:42.895007 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-31f94baa-7cc8-4d38-bfd7-df9ddfc5d53e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] HTTP exception thrown: Instance af7c11c7-dddb-481d-9d57-af021c48e71b could not be found. Aug 05 10:32:42.896601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-31f94baa-7cc8-4d38-bfd7-df9ddfc5d53e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Request method failure captured: Aug 05 10:32:42.896601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b HTTP/1.1 Aug 05 10:32:42.896601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:32:42.896601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:32:42.896601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:32:42.896601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:32:42.896601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:32:42.896601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:32:42.896601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:32:42.896601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:32:42.896601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PBZO8RhFL-wHmpwJ5QJvc72mNkNYvZ8q0uG0FC-Fp1d2PpDrB0syMdLDDpwqBZNo6jtUo3FJEcmyawFXZsvKF20RTKPh3QbG4_FaYkt32Ou8SiBjxBGpshmcupc39RVzRXU4AcSvV1FCXutQBxrdPg4Oj2SEWSZhtrYFFLA2_I7X6E Aug 05 10:32:42.896601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:32:42.896601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:32:42.896601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:32:42.896601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:32:42.896601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 10:32:42.896601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:32:42.896601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:32:42.896601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 36a1fa6b4a754e47afb99e9b237ea400 Aug 05 10:32:42.896601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-192289825 Aug 05 10:32:42.896601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:32:42.896601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:32:42.898523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_36a1fa6b4a754e47afb99e9b237ea400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/36a1fa6b4a754e47afb99e9b237ea400"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/36a1fa6b4a754e47afb99e9b237ea400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/36a1fa6b4a754e47afb99e9b237ea400"}]}] Aug 05 10:32:42.898523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-AttachVolumeShelveTestJSON-192289825 Aug 05 10:32:42.898523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 36a1fa6b4a754e47afb99e9b237ea400 Aug 05 10:32:42.898523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-192289825 Aug 05 10:32:42.898523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-AttachVolumeShelveTestJSON-192289825-project Aug 05 10:32:42.898523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:32:42.898523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:32:42.898523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: 97f671de92d240ae85ca4893d1ff04e5 Aug 05 10:32:42.898523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-AttachVolumeShelveTestJSON-192289825-project Aug 05 10:32:42.898523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: > Aug 05 10:32:42.898523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Instance af7c11c7-dddb-481d-9d57-af021c48e71b could not be found. Aug 05 10:32:42.898523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'id': 'af7c11c7-dddb-481d-9d57-af021c48e71b'} Aug 05 10:32:42.899478 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:32:42.899478 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:32:42.899478 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:32:42.899478 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:32:42.899478 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:32:42.899478 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:32:42.899478 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:32:42.899478 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:32:42.899478 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:32:42.899478 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:32:42.899478 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7c11c7-dddb-481d-9d57-af021c48e71b could not be found. Aug 05 10:32:42.899478 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:32:42.899478 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:32:42.899478 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:32:42.899478 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:32:42.899478 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:32:42.899478 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:32:42.899478 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:32:42.899478 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:32:42.899478 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:32:42.901225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:32:42.901225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:32:42.901225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:32:42.901225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:32:42.901225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:32:42.901225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:32:42.901225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:32:42.901225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7c11c7-dddb-481d-9d57-af021c48e71b could not be found. Aug 05 10:32:42.901225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:32:42.901225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:32:42.901225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:32:42.901225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:32:42.901225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:32:42.901225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:32:42.901225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:32:42.901225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:32:42.901225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7c11c7-dddb-481d-9d57-af021c48e71b could not be found. Aug 05 10:32:42.901225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:32:42.902848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-31f94baa-7cc8-4d38-bfd7-df9ddfc5d53e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Returning 404 to user: Instance af7c11c7-dddb-481d-9d57-af021c48e71b could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:32:42.902848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-31f94baa-7cc8-4d38-bfd7-df9ddfc5d53e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 404 len: 111 microversion: 2.20 time: 0.031939 Aug 05 10:32:42.902848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 398/812] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:32:42 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 10:32:42.907714 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-daf53b18-e2e8-408b-a60e-614c5451ab8c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '.version_select at 0x7f732767ee50>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:42.914524 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:32:42.930011 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-daf53b18-e2e8-408b-a60e-614c5451ab8c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-925510339" status: 204 len: 0 microversion: 2.20 time: 0.026158 Aug 05 10:32:42.930784 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 415/813] 10.222.0.40 () {60 vars in 1259 bytes} [Fri Aug 5 10:32:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-925510339 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 05 10:32:43.459177 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-5dd3802a-c551-4259-9cb7-551910015621 req-2ccc8b2e-3872-412c-aacc-4b6d365b3453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7c11c7-dddb-481d-9d57-af021c48e71b", "name": "network-vif-deleted", "tag": "9e68983d-a83c-49ba-ac19-3c316e21a882"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:32:43.468726 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-5dd3802a-c551-4259-9cb7-551910015621 req-2ccc8b2e-3872-412c-aacc-4b6d365b3453 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:43.469197 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-5dd3802a-c551-4259-9cb7-551910015621 req-2ccc8b2e-3872-412c-aacc-4b6d365b3453 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:43.469646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-5dd3802a-c551-4259-9cb7-551910015621 req-2ccc8b2e-3872-412c-aacc-4b6d365b3453 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:43.481242 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-5dd3802a-c551-4259-9cb7-551910015621 req-2ccc8b2e-3872-412c-aacc-4b6d365b3453 service nova] Creating event network-vif-deleted:9e68983d-a83c-49ba-ac19-3c316e21a882 for instance af7c11c7-dddb-481d-9d57-af021c48e71b on hv-cinder-81558 Aug 05 10:32:43.486248 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-5dd3802a-c551-4259-9cb7-551910015621 req-2ccc8b2e-3872-412c-aacc-4b6d365b3453 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030887 Aug 05 10:32:43.486843 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 399/814] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:32:44.018116 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-25af10b8-c858-4f57-aae2-4b6cd511c4a5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Action: 'create', calling method: .version_select at 0x7f732767e790>, body: {"keypair": {"name": "tempest-keypair-1730547715", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArxkwsyK5W+3LjZtOSsB488rxxzmraitTWqBt4aN+bdsf6f4PpYJYt17ukNbNml1OHrVGXa1k2AAJYTgQMu7sscdAeHIuU2QbgX7pOznnaFpYr328twasCaRrM1VWqncA=="}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:32:44.034389 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-25af10b8-c858-4f57-aae2-4b6cd511c4a5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Getting quotas for project 36a1fa6b4a754e47afb99e9b237ea400. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:32:44.038591 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-25af10b8-c858-4f57-aae2-4b6cd511c4a5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Getting quotas for user 97f671de92d240ae85ca4893d1ff04e5 and project 36a1fa6b4a754e47afb99e9b237ea400. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:32:44.061713 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-25af10b8-c858-4f57-aae2-4b6cd511c4a5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048716 Aug 05 10:32:44.062305 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 416/815] 10.222.0.40 () {62 vars in 1200 bytes} [Fri Aug 5 10:32:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 05 10:32:46.251599 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-6201c0d3-1094-4903-9bd7-debcbc321bf0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1864948968", "imageRef": "6163bb7c-dfd7-4fb1-a3cb-9f4818243f78", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0e109e3-8d82-41e1-9f13-a0b45cc03a92"}], "security_groups": [{"name": "tempest-securitygroup--1524591005"}], "key_name": "tempest-keypair-1730547715", "user_data": "}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:32:46.371542 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.network.neutron [None req-6201c0d3-1094-4903-9bd7-debcbc321bf0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] validate_networks() for [('a0e109e3-8d82-41e1-9f13-a0b45cc03a92', None, None, None, None, None)] {{(pid=117831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 10:32:46.965714 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-6201c0d3-1094-4903-9bd7-debcbc321bf0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Flavor limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 10:32:46.966240 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-6201c0d3-1094-4903-9bd7-debcbc321bf0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Image limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 10:32:46.966813 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-6201c0d3-1094-4903-9bd7-debcbc321bf0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Flavor pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 10:32:46.967345 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-6201c0d3-1094-4903-9bd7-debcbc321bf0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Image pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 10:32:46.967854 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-6201c0d3-1094-4903-9bd7-debcbc321bf0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 10:32:46.979591 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6201c0d3-1094-4903-9bd7-debcbc321bf0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:46.980078 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6201c0d3-1094-4903-9bd7-debcbc321bf0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:46.980512 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6201c0d3-1094-4903-9bd7-debcbc321bf0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:46.981240 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6201c0d3-1094-4903-9bd7-debcbc321bf0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:46.981690 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6201c0d3-1094-4903-9bd7-debcbc321bf0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:46.982143 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6201c0d3-1094-4903-9bd7-debcbc321bf0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:47.008454 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-6201c0d3-1094-4903-9bd7-debcbc321bf0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Getting quotas for project 36a1fa6b4a754e47afb99e9b237ea400. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:32:47.012555 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-6201c0d3-1094-4903-9bd7-debcbc321bf0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Getting quotas for user 97f671de92d240ae85ca4893d1ff04e5 and project 36a1fa6b4a754e47afb99e9b237ea400. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:32:47.023978 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-6201c0d3-1094-4903-9bd7-debcbc321bf0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Going to run 1 instances... {{(pid=117831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 10:32:47.026730 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-6201c0d3-1094-4903-9bd7-debcbc321bf0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6163bb7c-dfd7-4fb1-a3cb-9f4818243f78',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 10:32:47.081068 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-6201c0d3-1094-4903-9bd7-debcbc321bf0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.835686 Aug 05 10:32:47.082127 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 400/816] 10.222.0.40 () {62 vars in 1188 bytes} [Fri Aug 5 10:32:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 05 10:32:47.094732 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0bc8a29f-6616-4627-8f0b-634451d59395 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:47.096625 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0bc8a29f-6616-4627-8f0b-634451d59395 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:47.194303 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0bc8a29f-6616-4627-8f0b-634451d59395 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:47.202051 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0bc8a29f-6616-4627-8f0b-634451d59395 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:47.203802 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0bc8a29f-6616-4627-8f0b-634451d59395 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:47.205118 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0bc8a29f-6616-4627-8f0b-634451d59395 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1282 microversion: 2.20 time: 0.115767 Aug 05 10:32:47.206334 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 417/817] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:32:47 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1282 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:32:48.228191 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-9ece6f95-ec79-4ecb-9450-e3c16176b883 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:48.229014 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-9ece6f95-ec79-4ecb-9450-e3c16176b883 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:48.236726 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9ece6f95-ec79-4ecb-9450-e3c16176b883 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:48.237214 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9ece6f95-ec79-4ecb-9450-e3c16176b883 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:48.237641 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9ece6f95-ec79-4ecb-9450-e3c16176b883 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:48.238341 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9ece6f95-ec79-4ecb-9450-e3c16176b883 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:48.239147 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9ece6f95-ec79-4ecb-9450-e3c16176b883 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:48.239569 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9ece6f95-ec79-4ecb-9450-e3c16176b883 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:48.321089 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-9ece6f95-ec79-4ecb-9450-e3c16176b883 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:48.330184 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-9ece6f95-ec79-4ecb-9450-e3c16176b883 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:48.331792 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-9ece6f95-ec79-4ecb-9450-e3c16176b883 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:48.332932 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-9ece6f95-ec79-4ecb-9450-e3c16176b883 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1342 microversion: 2.20 time: 0.108955 Aug 05 10:32:48.333450 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 401/818] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:32:48 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1342 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:32:49.356135 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-60c6f9a2-7ca7-495c-bf63-cf5e4eab3558 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:49.356858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-60c6f9a2-7ca7-495c-bf63-cf5e4eab3558 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:49.365487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60c6f9a2-7ca7-495c-bf63-cf5e4eab3558 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:49.366088 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60c6f9a2-7ca7-495c-bf63-cf5e4eab3558 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:49.366409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60c6f9a2-7ca7-495c-bf63-cf5e4eab3558 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:49.367219 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60c6f9a2-7ca7-495c-bf63-cf5e4eab3558 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:49.367651 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60c6f9a2-7ca7-495c-bf63-cf5e4eab3558 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:49.368033 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60c6f9a2-7ca7-495c-bf63-cf5e4eab3558 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:49.434535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-60c6f9a2-7ca7-495c-bf63-cf5e4eab3558 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:49.443201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-60c6f9a2-7ca7-495c-bf63-cf5e4eab3558 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:49.444831 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-60c6f9a2-7ca7-495c-bf63-cf5e4eab3558 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:49.445948 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-60c6f9a2-7ca7-495c-bf63-cf5e4eab3558 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1340 microversion: 2.20 time: 0.093917 Aug 05 10:32:49.446513 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 418/819] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:32:49 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1340 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:32:50.443731 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-32d3dd71-a1c4-4e02-bcba-b950502b3a32 req-090a7caa-4fef-4b78-bef9-322074b339ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de6a3f62-cb68-4fa9-8c79-b99880a9e1ca", "tag": "98cf9379-6188-4844-b4f6-4476ddfb8a7d"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:32:50.454383 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-32d3dd71-a1c4-4e02-bcba-b950502b3a32 req-090a7caa-4fef-4b78-bef9-322074b339ff service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:50.455160 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-32d3dd71-a1c4-4e02-bcba-b950502b3a32 req-090a7caa-4fef-4b78-bef9-322074b339ff service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:50.455777 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-32d3dd71-a1c4-4e02-bcba-b950502b3a32 req-090a7caa-4fef-4b78-bef9-322074b339ff service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:50.468877 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-924949d4-e8d8-4c14-a69b-c4059c9b94f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:50.470596 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-924949d4-e8d8-4c14-a69b-c4059c9b94f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:50.474119 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-32d3dd71-a1c4-4e02-bcba-b950502b3a32 req-090a7caa-4fef-4b78-bef9-322074b339ff service nova] Creating event network-changed:98cf9379-6188-4844-b4f6-4476ddfb8a7d for instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca on hv-cinder-81558 Aug 05 10:32:50.487978 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-32d3dd71-a1c4-4e02-bcba-b950502b3a32 req-090a7caa-4fef-4b78-bef9-322074b339ff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048416 Aug 05 10:32:50.492461 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 402/820] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:32:50.494732 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-924949d4-e8d8-4c14-a69b-c4059c9b94f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:50.498761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-924949d4-e8d8-4c14-a69b-c4059c9b94f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:50.500737 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-924949d4-e8d8-4c14-a69b-c4059c9b94f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:50.501675 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-924949d4-e8d8-4c14-a69b-c4059c9b94f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:50.502280 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-924949d4-e8d8-4c14-a69b-c4059c9b94f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:50.502798 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-924949d4-e8d8-4c14-a69b-c4059c9b94f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:50.921519 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-924949d4-e8d8-4c14-a69b-c4059c9b94f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:50.931089 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-924949d4-e8d8-4c14-a69b-c4059c9b94f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:50.932549 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-924949d4-e8d8-4c14-a69b-c4059c9b94f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:50.933644 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-924949d4-e8d8-4c14-a69b-c4059c9b94f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1408 microversion: 2.20 time: 0.468905 Aug 05 10:32:50.944589 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 419/821] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:32:50 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1408 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 10:32:51.958500 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-3bc637e3-a583-4f6d-96e0-b6c9361cf6dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:51.959761 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-3bc637e3-a583-4f6d-96e0-b6c9361cf6dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:51.965962 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3bc637e3-a583-4f6d-96e0-b6c9361cf6dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:51.966447 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3bc637e3-a583-4f6d-96e0-b6c9361cf6dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:51.966916 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3bc637e3-a583-4f6d-96e0-b6c9361cf6dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:51.967585 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3bc637e3-a583-4f6d-96e0-b6c9361cf6dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:51.968028 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3bc637e3-a583-4f6d-96e0-b6c9361cf6dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:51.968444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3bc637e3-a583-4f6d-96e0-b6c9361cf6dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:52.136430 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-3bc637e3-a583-4f6d-96e0-b6c9361cf6dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:52.145379 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-3bc637e3-a583-4f6d-96e0-b6c9361cf6dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:52.147496 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-3bc637e3-a583-4f6d-96e0-b6c9361cf6dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:52.148785 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-3bc637e3-a583-4f6d-96e0-b6c9361cf6dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1408 microversion: 2.20 time: 0.195111 Aug 05 10:32:52.149434 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 403/822] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:32:51 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1408 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:32:53.171815 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7df6dd7a-e1d5-4cc0-8c48-21e756635b4b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:53.172432 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7df6dd7a-e1d5-4cc0-8c48-21e756635b4b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:53.180596 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7df6dd7a-e1d5-4cc0-8c48-21e756635b4b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:53.181217 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7df6dd7a-e1d5-4cc0-8c48-21e756635b4b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:53.181806 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7df6dd7a-e1d5-4cc0-8c48-21e756635b4b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:53.182751 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7df6dd7a-e1d5-4cc0-8c48-21e756635b4b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:53.183377 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7df6dd7a-e1d5-4cc0-8c48-21e756635b4b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:53.183809 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7df6dd7a-e1d5-4cc0-8c48-21e756635b4b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:53.326477 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7df6dd7a-e1d5-4cc0-8c48-21e756635b4b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:53.335362 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7df6dd7a-e1d5-4cc0-8c48-21e756635b4b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:53.336947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7df6dd7a-e1d5-4cc0-8c48-21e756635b4b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:53.338105 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7df6dd7a-e1d5-4cc0-8c48-21e756635b4b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1408 microversion: 2.20 time: 0.170430 Aug 05 10:32:53.338679 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 420/823] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:32:53 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:32:54.365697 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-6e9eb584-db4d-4ccf-a680-4f1fffe41d88 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:54.366805 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-6e9eb584-db4d-4ccf-a680-4f1fffe41d88 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:54.378060 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6e9eb584-db4d-4ccf-a680-4f1fffe41d88 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:54.378845 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6e9eb584-db4d-4ccf-a680-4f1fffe41d88 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:54.379617 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6e9eb584-db4d-4ccf-a680-4f1fffe41d88 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:54.380840 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6e9eb584-db4d-4ccf-a680-4f1fffe41d88 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:54.381292 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6e9eb584-db4d-4ccf-a680-4f1fffe41d88 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:54.381717 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6e9eb584-db4d-4ccf-a680-4f1fffe41d88 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:54.521977 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-6e9eb584-db4d-4ccf-a680-4f1fffe41d88 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:54.530379 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-6e9eb584-db4d-4ccf-a680-4f1fffe41d88 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:54.531882 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-6e9eb584-db4d-4ccf-a680-4f1fffe41d88 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:54.532977 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-6e9eb584-db4d-4ccf-a680-4f1fffe41d88 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1408 microversion: 2.20 time: 0.174604 Aug 05 10:32:54.533536 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 404/824] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:32:54 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:32:55.559852 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6f049114-e503-486c-84fc-1e2007866ef7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:55.560781 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6f049114-e503-486c-84fc-1e2007866ef7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:55.570784 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f049114-e503-486c-84fc-1e2007866ef7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:55.571293 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f049114-e503-486c-84fc-1e2007866ef7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:55.571719 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f049114-e503-486c-84fc-1e2007866ef7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:55.572403 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f049114-e503-486c-84fc-1e2007866ef7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:55.572845 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f049114-e503-486c-84fc-1e2007866ef7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:55.573283 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f049114-e503-486c-84fc-1e2007866ef7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:55.721205 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6f049114-e503-486c-84fc-1e2007866ef7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:55.733387 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6f049114-e503-486c-84fc-1e2007866ef7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:55.735315 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6f049114-e503-486c-84fc-1e2007866ef7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:55.736910 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6f049114-e503-486c-84fc-1e2007866ef7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1408 microversion: 2.20 time: 0.183343 Aug 05 10:32:55.737695 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 421/825] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:32:55 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:32:56.361568 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-43c591d6-ae5e-43ec-b4b0-2f1f75e0a3d1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:56.362088 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-43c591d6-ae5e-43ec-b4b0-2f1f75e0a3d1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:56.369808 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-43c591d6-ae5e-43ec-b4b0-2f1f75e0a3d1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:56.370281 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-43c591d6-ae5e-43ec-b4b0-2f1f75e0a3d1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:56.370708 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-43c591d6-ae5e-43ec-b4b0-2f1f75e0a3d1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:56.371425 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-43c591d6-ae5e-43ec-b4b0-2f1f75e0a3d1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:56.371872 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-43c591d6-ae5e-43ec-b4b0-2f1f75e0a3d1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:56.372286 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-43c591d6-ae5e-43ec-b4b0-2f1f75e0a3d1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:56.462637 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.objects.instance [None req-43c591d6-ae5e-43ec-b4b0-2f1f75e0a3d1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lazy-loading 'services' on Instance uuid 94bc927e-f379-4a93-a980-289f58af66f9 {{(pid=117831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:32:56.542733 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-43c591d6-ae5e-43ec-b4b0-2f1f75e0a3d1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "DELETE /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9/os-volume_attachments/aeb10a98-520c-494d-80ea-7cc61a200ff8" status: 202 len: 0 microversion: 2.1 time: 0.185215 Aug 05 10:32:56.543695 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 405/826] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 5 10:32:56 2022] DELETE /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9/os-volume_attachments/aeb10a98-520c-494d-80ea-7cc61a200ff8 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:32:56.554879 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-88d3fc7e-1dd9-4d9c-9a88-adf2961f4ebe tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:56.557146 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-88d3fc7e-1dd9-4d9c-9a88-adf2961f4ebe tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:56.563419 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88d3fc7e-1dd9-4d9c-9a88-adf2961f4ebe tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:56.564032 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88d3fc7e-1dd9-4d9c-9a88-adf2961f4ebe tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:56.564318 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88d3fc7e-1dd9-4d9c-9a88-adf2961f4ebe tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:56.565041 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88d3fc7e-1dd9-4d9c-9a88-adf2961f4ebe tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:56.565479 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88d3fc7e-1dd9-4d9c-9a88-adf2961f4ebe tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:56.565879 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88d3fc7e-1dd9-4d9c-9a88-adf2961f4ebe tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:56.595259 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-88d3fc7e-1dd9-4d9c-9a88-adf2961f4ebe tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045444 Aug 05 10:32:56.595856 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 422/827] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 10:32:56 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:32:56.759626 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-761ea93c-10f4-4138-827b-a2d7a25bde6e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:56.760291 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-761ea93c-10f4-4138-827b-a2d7a25bde6e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:56.767624 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-761ea93c-10f4-4138-827b-a2d7a25bde6e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:56.768113 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-761ea93c-10f4-4138-827b-a2d7a25bde6e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:56.768541 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-761ea93c-10f4-4138-827b-a2d7a25bde6e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:56.769241 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-761ea93c-10f4-4138-827b-a2d7a25bde6e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:56.769673 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-761ea93c-10f4-4138-827b-a2d7a25bde6e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:56.770151 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-761ea93c-10f4-4138-827b-a2d7a25bde6e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:56.790183 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-26d56dfb-ac50-4663-ae71-fcb628a87984 req-fbaec36c-2528-436e-bbfd-7d3526b0cabc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6a3f62-cb68-4fa9-8c79-b99880a9e1ca", "name": "network-vif-plugged", "status": "completed", "tag": "98cf9379-6188-4844-b4f6-4476ddfb8a7d"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:32:56.801786 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-26d56dfb-ac50-4663-ae71-fcb628a87984 req-fbaec36c-2528-436e-bbfd-7d3526b0cabc service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:56.802332 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-26d56dfb-ac50-4663-ae71-fcb628a87984 req-fbaec36c-2528-436e-bbfd-7d3526b0cabc service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:56.802738 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-26d56dfb-ac50-4663-ae71-fcb628a87984 req-fbaec36c-2528-436e-bbfd-7d3526b0cabc service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:56.818833 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-26d56dfb-ac50-4663-ae71-fcb628a87984 req-fbaec36c-2528-436e-bbfd-7d3526b0cabc service nova] Creating event network-vif-plugged:98cf9379-6188-4844-b4f6-4476ddfb8a7d for instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca on hv-cinder-81558 Aug 05 10:32:56.824287 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-26d56dfb-ac50-4663-ae71-fcb628a87984 req-fbaec36c-2528-436e-bbfd-7d3526b0cabc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037908 Aug 05 10:32:56.825341 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 423/828] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:32:56.908133 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-761ea93c-10f4-4138-827b-a2d7a25bde6e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:56.916303 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-761ea93c-10f4-4138-827b-a2d7a25bde6e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:56.917771 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-761ea93c-10f4-4138-827b-a2d7a25bde6e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:56.918864 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-761ea93c-10f4-4138-827b-a2d7a25bde6e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1408 microversion: 2.20 time: 0.163583 Aug 05 10:32:56.919421 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 406/829] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:32:56 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:32:57.605501 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:32:57.609969 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7a48cec9-a1f3-4be9-8341-49e6bf390ee0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:57.612377 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7a48cec9-a1f3-4be9-8341-49e6bf390ee0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:57.619163 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a48cec9-a1f3-4be9-8341-49e6bf390ee0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:57.619636 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a48cec9-a1f3-4be9-8341-49e6bf390ee0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:57.620068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a48cec9-a1f3-4be9-8341-49e6bf390ee0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:57.620891 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a48cec9-a1f3-4be9-8341-49e6bf390ee0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:57.621401 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a48cec9-a1f3-4be9-8341-49e6bf390ee0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:57.621843 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a48cec9-a1f3-4be9-8341-49e6bf390ee0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:57.655136 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7a48cec9-a1f3-4be9-8341-49e6bf390ee0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050322 Aug 05 10:32:57.655665 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 424/830] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 10:32:57 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:32:57.943156 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d8560908-4c9b-4e30-90e4-0106425f246c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:57.943909 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d8560908-4c9b-4e30-90e4-0106425f246c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:57.945697 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=2 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:32:57.946352 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=6 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:32:57.952683 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d8560908-4c9b-4e30-90e4-0106425f246c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:57.953145 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d8560908-4c9b-4e30-90e4-0106425f246c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:57.953580 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d8560908-4c9b-4e30-90e4-0106425f246c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:57.954270 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d8560908-4c9b-4e30-90e4-0106425f246c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:57.954726 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d8560908-4c9b-4e30-90e4-0106425f246c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:57.955178 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d8560908-4c9b-4e30-90e4-0106425f246c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:58.098732 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d8560908-4c9b-4e30-90e4-0106425f246c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:58.107156 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d8560908-4c9b-4e30-90e4-0106425f246c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:58.108634 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d8560908-4c9b-4e30-90e4-0106425f246c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:58.109726 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d8560908-4c9b-4e30-90e4-0106425f246c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1408 microversion: 2.20 time: 0.170771 Aug 05 10:32:58.110281 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 407/831] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:32:57 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:32:58.672149 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1602865c-f0aa-45c1-988b-78cf91e3ee57 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:58.675630 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1602865c-f0aa-45c1-988b-78cf91e3ee57 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:58.687041 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1602865c-f0aa-45c1-988b-78cf91e3ee57 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:58.687834 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1602865c-f0aa-45c1-988b-78cf91e3ee57 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:58.688538 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1602865c-f0aa-45c1-988b-78cf91e3ee57 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:58.689672 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1602865c-f0aa-45c1-988b-78cf91e3ee57 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:58.690408 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1602865c-f0aa-45c1-988b-78cf91e3ee57 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:58.691135 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1602865c-f0aa-45c1-988b-78cf91e3ee57 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:58.722767 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1602865c-f0aa-45c1-988b-78cf91e3ee57 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057418 Aug 05 10:32:58.723310 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 425/832] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 10:32:58 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 10:32:58.805599 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-95873d77-688d-4cf7-b7d5-832685213705 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:58.806228 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-95873d77-688d-4cf7-b7d5-832685213705 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:58.812507 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-95873d77-688d-4cf7-b7d5-832685213705 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:58.812991 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-95873d77-688d-4cf7-b7d5-832685213705 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:58.813425 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-95873d77-688d-4cf7-b7d5-832685213705 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:58.814112 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-95873d77-688d-4cf7-b7d5-832685213705 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:58.814563 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-95873d77-688d-4cf7-b7d5-832685213705 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:58.815020 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-95873d77-688d-4cf7-b7d5-832685213705 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:58.839422 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-95873d77-688d-4cf7-b7d5-832685213705 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Going to try to terminate instance {{(pid=117831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 10:32:58.865485 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:32:58.925625 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-95873d77-688d-4cf7-b7d5-832685213705 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "DELETE /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 204 len: 0 microversion: 2.1 time: 0.124816 Aug 05 10:32:58.926474 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 408/833] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:32:58 2022] DELETE /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:32:58.936005 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5c94db26-2ba5-47e4-b09e-0b39a5f39548 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:58.936618 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5c94db26-2ba5-47e4-b09e-0b39a5f39548 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:58.943122 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5c94db26-2ba5-47e4-b09e-0b39a5f39548 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:58.944187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5c94db26-2ba5-47e4-b09e-0b39a5f39548 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:58.944633 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5c94db26-2ba5-47e4-b09e-0b39a5f39548 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:58.945327 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5c94db26-2ba5-47e4-b09e-0b39a5f39548 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:58.945780 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5c94db26-2ba5-47e4-b09e-0b39a5f39548 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:58.946202 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5c94db26-2ba5-47e4-b09e-0b39a5f39548 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:59.087489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5c94db26-2ba5-47e4-b09e-0b39a5f39548 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:59.098930 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5c94db26-2ba5-47e4-b09e-0b39a5f39548 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1688 microversion: 2.1 time: 0.166633 Aug 05 10:32:59.100126 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 426/834] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:32:58 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:32:59.133368 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-1e8f59a5-fc05-4e86-a07d-678d90603190 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:32:59.134071 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-1e8f59a5-fc05-4e86-a07d-678d90603190 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:32:59.140838 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1e8f59a5-fc05-4e86-a07d-678d90603190 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:59.141320 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1e8f59a5-fc05-4e86-a07d-678d90603190 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:59.141751 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1e8f59a5-fc05-4e86-a07d-678d90603190 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:59.142440 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1e8f59a5-fc05-4e86-a07d-678d90603190 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:32:59.142884 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1e8f59a5-fc05-4e86-a07d-678d90603190 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:32:59.143334 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1e8f59a5-fc05-4e86-a07d-678d90603190 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:32:59.280201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-1e8f59a5-fc05-4e86-a07d-678d90603190 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:59.289266 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-1e8f59a5-fc05-4e86-a07d-678d90603190 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:59.290676 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-1e8f59a5-fc05-4e86-a07d-678d90603190 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:32:59.291810 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-1e8f59a5-fc05-4e86-a07d-678d90603190 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1408 microversion: 2.20 time: 0.163057 Aug 05 10:32:59.292369 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 409/835] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:32:59 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:33:00.125708 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-134d9d8e-42dc-43e8-965f-85d66197f2cb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:00.126692 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-134d9d8e-42dc-43e8-965f-85d66197f2cb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:00.135440 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-134d9d8e-42dc-43e8-965f-85d66197f2cb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:00.135915 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-134d9d8e-42dc-43e8-965f-85d66197f2cb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:00.136344 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-134d9d8e-42dc-43e8-965f-85d66197f2cb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:00.137027 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-134d9d8e-42dc-43e8-965f-85d66197f2cb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:00.137470 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-134d9d8e-42dc-43e8-965f-85d66197f2cb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:00.137883 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-134d9d8e-42dc-43e8-965f-85d66197f2cb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:00.141830 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:33:00.275202 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-134d9d8e-42dc-43e8-965f-85d66197f2cb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:00.284536 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-134d9d8e-42dc-43e8-965f-85d66197f2cb tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1688 microversion: 2.1 time: 0.165721 Aug 05 10:33:00.285296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 427/836] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:00 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:00.314121 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-5dadbc43-0ae8-44f1-8cb7-2bfc60105c31 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:00.314731 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-5dadbc43-0ae8-44f1-8cb7-2bfc60105c31 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:00.321915 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5dadbc43-0ae8-44f1-8cb7-2bfc60105c31 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:00.322396 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5dadbc43-0ae8-44f1-8cb7-2bfc60105c31 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:00.322826 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5dadbc43-0ae8-44f1-8cb7-2bfc60105c31 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:00.323549 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5dadbc43-0ae8-44f1-8cb7-2bfc60105c31 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:00.323996 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5dadbc43-0ae8-44f1-8cb7-2bfc60105c31 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:00.324415 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5dadbc43-0ae8-44f1-8cb7-2bfc60105c31 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:00.463702 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-5dadbc43-0ae8-44f1-8cb7-2bfc60105c31 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:00.475725 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-5dadbc43-0ae8-44f1-8cb7-2bfc60105c31 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:00.478051 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-5dadbc43-0ae8-44f1-8cb7-2bfc60105c31 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:00.479673 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-5dadbc43-0ae8-44f1-8cb7-2bfc60105c31 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1408 microversion: 2.20 time: 0.169339 Aug 05 10:33:00.480456 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 410/837] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:33:00 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:33:01.313877 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a100787e-eb21-4287-8d9f-4c824c6fafc6 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:01.314783 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a100787e-eb21-4287-8d9f-4c824c6fafc6 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:01.323417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a100787e-eb21-4287-8d9f-4c824c6fafc6 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:01.323892 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a100787e-eb21-4287-8d9f-4c824c6fafc6 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:01.324321 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a100787e-eb21-4287-8d9f-4c824c6fafc6 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:01.325004 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a100787e-eb21-4287-8d9f-4c824c6fafc6 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:01.325449 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a100787e-eb21-4287-8d9f-4c824c6fafc6 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:01.325858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a100787e-eb21-4287-8d9f-4c824c6fafc6 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:01.465613 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a100787e-eb21-4287-8d9f-4c824c6fafc6 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:01.473644 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a100787e-eb21-4287-8d9f-4c824c6fafc6 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1688 microversion: 2.1 time: 0.165351 Aug 05 10:33:01.474224 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 428/838] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:01 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:01.504700 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-8d9fcb32-421d-400f-a2df-046bf1642c78 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:01.505308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-8d9fcb32-421d-400f-a2df-046bf1642c78 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:01.512109 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8d9fcb32-421d-400f-a2df-046bf1642c78 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:01.512594 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8d9fcb32-421d-400f-a2df-046bf1642c78 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:01.513028 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8d9fcb32-421d-400f-a2df-046bf1642c78 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:01.513714 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8d9fcb32-421d-400f-a2df-046bf1642c78 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:01.514167 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8d9fcb32-421d-400f-a2df-046bf1642c78 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:01.514590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8d9fcb32-421d-400f-a2df-046bf1642c78 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:01.660031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-8d9fcb32-421d-400f-a2df-046bf1642c78 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:01.673104 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-8d9fcb32-421d-400f-a2df-046bf1642c78 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:01.675498 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-8d9fcb32-421d-400f-a2df-046bf1642c78 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:01.677312 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-8d9fcb32-421d-400f-a2df-046bf1642c78 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1408 microversion: 2.20 time: 0.176315 Aug 05 10:33:01.678024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 411/839] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:33:01 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:33:02.498222 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6fb71193-71d3-485e-83da-2894db96fc73 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:02.499013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6fb71193-71d3-485e-83da-2894db96fc73 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:02.506953 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fb71193-71d3-485e-83da-2894db96fc73 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:02.507502 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fb71193-71d3-485e-83da-2894db96fc73 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:02.507997 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fb71193-71d3-485e-83da-2894db96fc73 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:02.508794 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fb71193-71d3-485e-83da-2894db96fc73 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:02.509319 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fb71193-71d3-485e-83da-2894db96fc73 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:02.509835 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fb71193-71d3-485e-83da-2894db96fc73 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:02.646155 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6fb71193-71d3-485e-83da-2894db96fc73 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:02.654751 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6fb71193-71d3-485e-83da-2894db96fc73 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1688 microversion: 2.1 time: 0.162620 Aug 05 10:33:02.655368 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 429/840] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:02 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:02.699976 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-4d52be53-534a-4d6c-9491-23cf68733ebe tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:02.700548 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-4d52be53-534a-4d6c-9491-23cf68733ebe tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:02.707551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4d52be53-534a-4d6c-9491-23cf68733ebe tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:02.708034 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4d52be53-534a-4d6c-9491-23cf68733ebe tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:02.708468 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4d52be53-534a-4d6c-9491-23cf68733ebe tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:02.709166 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4d52be53-534a-4d6c-9491-23cf68733ebe tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:02.709621 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4d52be53-534a-4d6c-9491-23cf68733ebe tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:02.710046 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4d52be53-534a-4d6c-9491-23cf68733ebe tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:02.768811 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2b5cf207-e5fe-4fa0-93c1-303fa247196c tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:33:02.769347 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2b5cf207-e5fe-4fa0-93c1-303fa247196c tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:02.776213 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b5cf207-e5fe-4fa0-93c1-303fa247196c tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:02.776694 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b5cf207-e5fe-4fa0-93c1-303fa247196c tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:02.777123 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b5cf207-e5fe-4fa0-93c1-303fa247196c tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:02.777808 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b5cf207-e5fe-4fa0-93c1-303fa247196c tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:02.778251 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b5cf207-e5fe-4fa0-93c1-303fa247196c tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:02.778643 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b5cf207-e5fe-4fa0-93c1-303fa247196c tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:02.801577 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-2b5cf207-e5fe-4fa0-93c1-303fa247196c tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lazy-loading 'flavor' on Instance uuid b987816b-37ef-46a2-b94e-5c3954662b58 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:33:02.858260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-4d52be53-534a-4d6c-9491-23cf68733ebe tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:02.867604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-4d52be53-534a-4d6c-9491-23cf68733ebe tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:02.869095 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-4d52be53-534a-4d6c-9491-23cf68733ebe tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:02.870466 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-4d52be53-534a-4d6c-9491-23cf68733ebe tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1600 microversion: 2.20 time: 0.175037 Aug 05 10:33:02.871041 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 412/841] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:33:02 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1600 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:33:02.881100 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2b5cf207-e5fe-4fa0-93c1-303fa247196c tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "POST /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58/action" status: 202 len: 0 microversion: 2.1 time: 0.116497 Aug 05 10:33:02.881685 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 430/842] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 10:33:02 2022] POST /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:33:02.890322 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-9ff39611-47a2-4ae3-bf98-9e5dd5007bb7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:02.891237 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-9ff39611-47a2-4ae3-bf98-9e5dd5007bb7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:02.893269 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0f324d34-ee84-4fa5-9bbe-b607f1f8e169 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:02.893862 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0f324d34-ee84-4fa5-9bbe-b607f1f8e169 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:02.898182 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9ff39611-47a2-4ae3-bf98-9e5dd5007bb7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:02.898680 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9ff39611-47a2-4ae3-bf98-9e5dd5007bb7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:02.899126 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9ff39611-47a2-4ae3-bf98-9e5dd5007bb7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:02.900167 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9ff39611-47a2-4ae3-bf98-9e5dd5007bb7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:02.900460 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f324d34-ee84-4fa5-9bbe-b607f1f8e169 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:02.900615 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9ff39611-47a2-4ae3-bf98-9e5dd5007bb7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:02.900993 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f324d34-ee84-4fa5-9bbe-b607f1f8e169 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:02.901144 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9ff39611-47a2-4ae3-bf98-9e5dd5007bb7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:02.901420 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f324d34-ee84-4fa5-9bbe-b607f1f8e169 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:02.902104 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f324d34-ee84-4fa5-9bbe-b607f1f8e169 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:02.902549 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f324d34-ee84-4fa5-9bbe-b607f1f8e169 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:02.902989 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f324d34-ee84-4fa5-9bbe-b607f1f8e169 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:02.987424 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0f324d34-ee84-4fa5-9bbe-b607f1f8e169 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098270 Aug 05 10:33:02.988029 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 431/843] 10.222.0.40 () {60 vars in 1316 bytes} [Fri Aug 5 10:33:02 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 10:33:03.038225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-9ff39611-47a2-4ae3-bf98-9e5dd5007bb7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:03.046492 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-9ff39611-47a2-4ae3-bf98-9e5dd5007bb7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1568 microversion: 2.1 time: 0.160089 Aug 05 10:33:03.047091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 413/844] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:02 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:03.684883 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-272f995d-be24-4a0e-951f-94b9a5b7df73 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:03.685992 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-272f995d-be24-4a0e-951f-94b9a5b7df73 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:03.694141 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-272f995d-be24-4a0e-951f-94b9a5b7df73 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:03.694871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-272f995d-be24-4a0e-951f-94b9a5b7df73 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:03.695450 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-272f995d-be24-4a0e-951f-94b9a5b7df73 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:03.696345 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-272f995d-be24-4a0e-951f-94b9a5b7df73 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:03.697006 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-272f995d-be24-4a0e-951f-94b9a5b7df73 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:03.697430 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-272f995d-be24-4a0e-951f-94b9a5b7df73 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:03.888989 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-272f995d-be24-4a0e-951f-94b9a5b7df73 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:03.898147 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-272f995d-be24-4a0e-951f-94b9a5b7df73 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 200 len: 1688 microversion: 2.1 time: 0.218269 Aug 05 10:33:03.898871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 432/845] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:03 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 1688 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:04.037030 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-88e86a70-fa3e-4adf-8fbd-9bf2aaf392a0 req-3004e545-3257-4d38-9f76-01ecc2a9579d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de6a3f62-cb68-4fa9-8c79-b99880a9e1ca", "tag": "98cf9379-6188-4844-b4f6-4476ddfb8a7d"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:33:04.048200 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-88e86a70-fa3e-4adf-8fbd-9bf2aaf392a0 req-3004e545-3257-4d38-9f76-01ecc2a9579d service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:04.048899 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-88e86a70-fa3e-4adf-8fbd-9bf2aaf392a0 req-3004e545-3257-4d38-9f76-01ecc2a9579d service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:04.049505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-88e86a70-fa3e-4adf-8fbd-9bf2aaf392a0 req-3004e545-3257-4d38-9f76-01ecc2a9579d service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:04.061681 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-88e86a70-fa3e-4adf-8fbd-9bf2aaf392a0 req-3004e545-3257-4d38-9f76-01ecc2a9579d service nova] Creating event network-changed:98cf9379-6188-4844-b4f6-4476ddfb8a7d for instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca on hv-cinder-81558 Aug 05 10:33:04.068556 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-88e86a70-fa3e-4adf-8fbd-9bf2aaf392a0 req-3004e545-3257-4d38-9f76-01ecc2a9579d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035152 Aug 05 10:33:04.069394 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cdaf5902-a54a-4989-a469-573c225fa25d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:04.070195 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 414/846] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:33:04.072726 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cdaf5902-a54a-4989-a469-573c225fa25d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:04.079176 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdaf5902-a54a-4989-a469-573c225fa25d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:04.079672 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdaf5902-a54a-4989-a469-573c225fa25d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:04.080106 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdaf5902-a54a-4989-a469-573c225fa25d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:04.080808 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdaf5902-a54a-4989-a469-573c225fa25d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:04.081263 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdaf5902-a54a-4989-a469-573c225fa25d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:04.081684 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdaf5902-a54a-4989-a469-573c225fa25d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:04.180707 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-b7fb75cb-df03-4bc7-9231-27eb989e1781 req-a1f44747-38b7-4cc6-a59a-4ec7dd6a58a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94bc927e-f379-4a93-a980-289f58af66f9", "name": "network-vif-deleted", "tag": "76d42f2f-ee41-465d-bac5-77d316e82d9d"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:33:04.205589 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-b7fb75cb-df03-4bc7-9231-27eb989e1781 req-a1f44747-38b7-4cc6-a59a-4ec7dd6a58a1 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:04.206260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-b7fb75cb-df03-4bc7-9231-27eb989e1781 req-a1f44747-38b7-4cc6-a59a-4ec7dd6a58a1 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:04.206713 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-b7fb75cb-df03-4bc7-9231-27eb989e1781 req-a1f44747-38b7-4cc6-a59a-4ec7dd6a58a1 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:04.229988 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-b7fb75cb-df03-4bc7-9231-27eb989e1781 req-a1f44747-38b7-4cc6-a59a-4ec7dd6a58a1 service nova] Creating event network-vif-deleted:76d42f2f-ee41-465d-bac5-77d316e82d9d for instance 94bc927e-f379-4a93-a980-289f58af66f9 on hv-cinder-81558 Aug 05 10:33:04.236409 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-b7fb75cb-df03-4bc7-9231-27eb989e1781 req-a1f44747-38b7-4cc6-a59a-4ec7dd6a58a1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066019 Aug 05 10:33:04.239750 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 415/847] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:33:04.376105 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cdaf5902-a54a-4989-a469-573c225fa25d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:04.392035 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cdaf5902-a54a-4989-a469-573c225fa25d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1568 microversion: 2.1 time: 0.327200 Aug 05 10:33:04.395973 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 433/848] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:04 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1568 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:04.922210 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b7c6ce20-459a-481e-91ff-9390bf77b6cf tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:04.923238 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b7c6ce20-459a-481e-91ff-9390bf77b6cf tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 94bc927e-f379-4a93-a980-289f58af66f9] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:04.934156 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b7c6ce20-459a-481e-91ff-9390bf77b6cf tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:04.935164 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b7c6ce20-459a-481e-91ff-9390bf77b6cf tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:04.935796 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b7c6ce20-459a-481e-91ff-9390bf77b6cf tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:04.940285 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b7c6ce20-459a-481e-91ff-9390bf77b6cf tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:04.942158 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b7c6ce20-459a-481e-91ff-9390bf77b6cf tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:04.942877 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b7c6ce20-459a-481e-91ff-9390bf77b6cf tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:04.958888 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-b7c6ce20-459a-481e-91ff-9390bf77b6cf tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] HTTP exception thrown: Instance 94bc927e-f379-4a93-a980-289f58af66f9 could not be found. Aug 05 10:33:04.961171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b7c6ce20-459a-481e-91ff-9390bf77b6cf tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Request method failure captured: Aug 05 10:33:04.961171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 HTTP/1.1 Aug 05 10:33:04.961171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:33:04.961171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:33:04.961171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:33:04.961171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:33:04.961171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:33:04.961171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:33:04.961171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:33:04.961171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:33:04.961171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PBLDFW-X3TEawahF022LKFEKV68Ad6QHuGA8zjD7iptWxegCnn7NLZ93P_TTqy3qTfPaJgoXQW6RoMmhvpe8LOMj4ugeXgyBba8RW5T7FaRUqiQbD8fVKZKJ6l7h0zXL8SVOmIKhkBmKk6oIc4sQHq4LfBFKZWadDD9oZ1zaftUols Aug 05 10:33:04.961171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:33:04.961171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:33:04.961171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:33:04.961171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:33:04.961171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:33:04.961171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:33:04.961171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 9ea83951557a48fcaab832aea2273453 Aug 05 10:33:04.961171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-739497926 Aug 05 10:33:04.961171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:33:04.961171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:33:04.962796 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9ea83951557a48fcaab832aea2273453"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9ea83951557a48fcaab832aea2273453"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ea83951557a48fcaab832aea2273453"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ea83951557a48fcaab832aea2273453"}]}] Aug 05 10:33:04.962796 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-ServerRescueNegativeTestJSON-739497926 Aug 05 10:33:04.962796 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 9ea83951557a48fcaab832aea2273453 Aug 05 10:33:04.962796 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-739497926 Aug 05 10:33:04.962796 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-ServerRescueNegativeTestJSON-739497926-project Aug 05 10:33:04.962796 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:33:04.962796 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:33:04.962796 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: a3b4d90bcfc34d2d9ba1c40316e09858 Aug 05 10:33:04.962796 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-ServerRescueNegativeTestJSON-739497926-project Aug 05 10:33:04.962796 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: > Aug 05 10:33:04.962796 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Instance 94bc927e-f379-4a93-a980-289f58af66f9 could not be found. Aug 05 10:33:04.962796 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'id': '94bc927e-f379-4a93-a980-289f58af66f9'} Aug 05 10:33:04.963834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:33:04.963834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:33:04.963834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:33:04.963834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:33:04.963834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:33:04.963834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:33:04.963834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:33:04.963834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:33:04.963834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:33:04.963834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:33:04.963834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94bc927e-f379-4a93-a980-289f58af66f9 could not be found. Aug 05 10:33:04.963834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:33:04.963834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:33:04.963834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:33:04.963834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:33:04.963834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:33:04.963834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:33:04.963834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:33:04.963834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:33:04.963834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:33:04.965328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:33:04.965328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:33:04.965328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:33:04.965328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:33:04.965328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:33:04.965328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:33:04.965328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:33:04.965328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94bc927e-f379-4a93-a980-289f58af66f9 could not be found. Aug 05 10:33:04.965328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:33:04.965328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:33:04.965328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:33:04.965328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:33:04.965328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:33:04.965328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:33:04.965328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:33:04.965328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:33:04.965328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94bc927e-f379-4a93-a980-289f58af66f9 could not be found. Aug 05 10:33:04.965328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:33:04.967670 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b7c6ce20-459a-481e-91ff-9390bf77b6cf tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Returning 404 to user: Instance 94bc927e-f379-4a93-a980-289f58af66f9 could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:33:04.968736 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b7c6ce20-459a-481e-91ff-9390bf77b6cf tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9" status: 404 len: 111 microversion: 2.1 time: 0.050835 Aug 05 10:33:04.969928 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 416/849] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:04 2022] GET /compute/v2.1/servers/94bc927e-f379-4a93-a980-289f58af66f9 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:33:04.978343 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-34d3b72b-2443-43ca-b07f-34dc0669bde1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '.version_select at 0x7f7327621160>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:05.011788 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-34d3b72b-2443-43ca-b07f-34dc0669bde1 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-691803767" status: 202 len: 0 microversion: 2.1 time: 0.037223 Aug 05 10:33:05.017181 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 434/850] 10.222.0.40 () {58 vars in 1218 bytes} [Fri Aug 5 10:33:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-691803767 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:33:05.415079 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-4826212d-a5f5-40dc-8777-a7de4a176ebc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:05.416416 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-4826212d-a5f5-40dc-8777-a7de4a176ebc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:05.424761 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4826212d-a5f5-40dc-8777-a7de4a176ebc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:05.425258 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4826212d-a5f5-40dc-8777-a7de4a176ebc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:05.425696 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4826212d-a5f5-40dc-8777-a7de4a176ebc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:05.426410 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4826212d-a5f5-40dc-8777-a7de4a176ebc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:05.426872 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4826212d-a5f5-40dc-8777-a7de4a176ebc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:05.431698 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4826212d-a5f5-40dc-8777-a7de4a176ebc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:05.636283 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-4826212d-a5f5-40dc-8777-a7de4a176ebc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:05.645326 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-4826212d-a5f5-40dc-8777-a7de4a176ebc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1568 microversion: 2.1 time: 0.234205 Aug 05 10:33:05.646397 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 417/851] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:05 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:33:06.671922 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-79a428bb-0eb2-47af-a7eb-a42df1c46c18 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:06.672586 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-79a428bb-0eb2-47af-a7eb-a42df1c46c18 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:06.679883 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-79a428bb-0eb2-47af-a7eb-a42df1c46c18 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:06.680373 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-79a428bb-0eb2-47af-a7eb-a42df1c46c18 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:06.680802 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-79a428bb-0eb2-47af-a7eb-a42df1c46c18 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:06.681475 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-79a428bb-0eb2-47af-a7eb-a42df1c46c18 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:06.681925 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-79a428bb-0eb2-47af-a7eb-a42df1c46c18 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:06.682343 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-79a428bb-0eb2-47af-a7eb-a42df1c46c18 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:06.825879 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-79a428bb-0eb2-47af-a7eb-a42df1c46c18 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:06.833507 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-79a428bb-0eb2-47af-a7eb-a42df1c46c18 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1568 microversion: 2.1 time: 0.166664 Aug 05 10:33:06.834051 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 435/852] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:06 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:07.859005 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-8898d77f-3b27-4d5c-84e7-83f3ec9d1d7a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:07.859625 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-8898d77f-3b27-4d5c-84e7-83f3ec9d1d7a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:07.866771 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8898d77f-3b27-4d5c-84e7-83f3ec9d1d7a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:07.867296 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8898d77f-3b27-4d5c-84e7-83f3ec9d1d7a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:07.867737 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8898d77f-3b27-4d5c-84e7-83f3ec9d1d7a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:07.868433 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8898d77f-3b27-4d5c-84e7-83f3ec9d1d7a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:07.868896 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8898d77f-3b27-4d5c-84e7-83f3ec9d1d7a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:07.869324 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8898d77f-3b27-4d5c-84e7-83f3ec9d1d7a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:08.014880 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-8898d77f-3b27-4d5c-84e7-83f3ec9d1d7a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:08.022952 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-8898d77f-3b27-4d5c-84e7-83f3ec9d1d7a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1568 microversion: 2.1 time: 0.170118 Aug 05 10:33:08.023541 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 418/853] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:07 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:08.132591 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fc79716a-af84-48a3-acc7-e100eacb1dc0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:08.133137 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fc79716a-af84-48a3-acc7-e100eacb1dc0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:08.140068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc79716a-af84-48a3-acc7-e100eacb1dc0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:08.140550 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc79716a-af84-48a3-acc7-e100eacb1dc0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:08.140980 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc79716a-af84-48a3-acc7-e100eacb1dc0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:08.141680 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc79716a-af84-48a3-acc7-e100eacb1dc0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:08.142127 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc79716a-af84-48a3-acc7-e100eacb1dc0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:08.142548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc79716a-af84-48a3-acc7-e100eacb1dc0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:08.169088 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fc79716a-af84-48a3-acc7-e100eacb1dc0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 10:33:08.250781 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fc79716a-af84-48a3-acc7-e100eacb1dc0 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 204 len: 0 microversion: 2.1 time: 0.121806 Aug 05 10:33:08.251426 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 436/854] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:33:08 2022] DELETE /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:33:08.259602 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-a2c78594-b407-46d9-bb43-7c30e23d7688 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:08.260215 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-a2c78594-b407-46d9-bb43-7c30e23d7688 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:08.266741 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a2c78594-b407-46d9-bb43-7c30e23d7688 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:08.267268 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a2c78594-b407-46d9-bb43-7c30e23d7688 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:08.267707 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a2c78594-b407-46d9-bb43-7c30e23d7688 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:08.268394 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a2c78594-b407-46d9-bb43-7c30e23d7688 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:08.268847 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a2c78594-b407-46d9-bb43-7c30e23d7688 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:08.269267 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-a2c78594-b407-46d9-bb43-7c30e23d7688 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:08.403702 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a2c78594-b407-46d9-bb43-7c30e23d7688 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:08.411798 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-a2c78594-b407-46d9-bb43-7c30e23d7688 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1506 microversion: 2.1 time: 0.156026 Aug 05 10:33:08.412366 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 419/855] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:08 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:09.048578 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7ec303f9-4dd6-48d2-98f3-b227f93fbdc7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:09.049390 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7ec303f9-4dd6-48d2-98f3-b227f93fbdc7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:09.058837 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7ec303f9-4dd6-48d2-98f3-b227f93fbdc7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:09.059644 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7ec303f9-4dd6-48d2-98f3-b227f93fbdc7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:09.060264 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7ec303f9-4dd6-48d2-98f3-b227f93fbdc7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:09.061318 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7ec303f9-4dd6-48d2-98f3-b227f93fbdc7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:09.062140 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7ec303f9-4dd6-48d2-98f3-b227f93fbdc7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:09.062560 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7ec303f9-4dd6-48d2-98f3-b227f93fbdc7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:09.226253 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7ec303f9-4dd6-48d2-98f3-b227f93fbdc7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:09.240307 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7ec303f9-4dd6-48d2-98f3-b227f93fbdc7 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1568 microversion: 2.1 time: 0.197695 Aug 05 10:33:09.241172 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 437/856] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:09 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:09.434919 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-aa9a9f7a-c56d-4f56-a365-0a9d8b2f9df8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:09.435578 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-aa9a9f7a-c56d-4f56-a365-0a9d8b2f9df8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:09.443953 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aa9a9f7a-c56d-4f56-a365-0a9d8b2f9df8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:09.444503 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aa9a9f7a-c56d-4f56-a365-0a9d8b2f9df8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:09.445009 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aa9a9f7a-c56d-4f56-a365-0a9d8b2f9df8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:09.445858 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aa9a9f7a-c56d-4f56-a365-0a9d8b2f9df8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:09.446317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aa9a9f7a-c56d-4f56-a365-0a9d8b2f9df8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:09.446802 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-aa9a9f7a-c56d-4f56-a365-0a9d8b2f9df8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:09.586888 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-aa9a9f7a-c56d-4f56-a365-0a9d8b2f9df8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:09.594713 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-aa9a9f7a-c56d-4f56-a365-0a9d8b2f9df8 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1506 microversion: 2.1 time: 0.164768 Aug 05 10:33:09.595311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 420/857] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:09 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:10.261700 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dcfab66b-05aa-4772-b724-96e8ecf46056 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:10.262487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dcfab66b-05aa-4772-b724-96e8ecf46056 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:10.270941 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dcfab66b-05aa-4772-b724-96e8ecf46056 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:10.271791 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dcfab66b-05aa-4772-b724-96e8ecf46056 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:10.272292 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dcfab66b-05aa-4772-b724-96e8ecf46056 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:10.273042 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dcfab66b-05aa-4772-b724-96e8ecf46056 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:10.274586 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dcfab66b-05aa-4772-b724-96e8ecf46056 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:10.275048 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dcfab66b-05aa-4772-b724-96e8ecf46056 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:10.406545 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dcfab66b-05aa-4772-b724-96e8ecf46056 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:10.414304 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dcfab66b-05aa-4772-b724-96e8ecf46056 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1568 microversion: 2.1 time: 0.156471 Aug 05 10:33:10.423520 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 438/858] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:10 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:10.546156 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-b63f9aa0-22be-43ed-8838-969813e7c385 req-8de583e6-d4bb-4961-b330-5a900ad8db26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6b3944-32c7-4652-be72-e448219cee78", "name": "network-vif-deleted", "tag": "0504379a-29d1-4c32-8abd-1c246bd31d77"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:33:10.558866 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-b63f9aa0-22be-43ed-8838-969813e7c385 req-8de583e6-d4bb-4961-b330-5a900ad8db26 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:10.559382 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-b63f9aa0-22be-43ed-8838-969813e7c385 req-8de583e6-d4bb-4961-b330-5a900ad8db26 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:10.559818 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-b63f9aa0-22be-43ed-8838-969813e7c385 req-8de583e6-d4bb-4961-b330-5a900ad8db26 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:10.573234 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-b63f9aa0-22be-43ed-8838-969813e7c385 req-8de583e6-d4bb-4961-b330-5a900ad8db26 service nova] Creating event network-vif-deleted:0504379a-29d1-4c32-8abd-1c246bd31d77 for instance 3d6b3944-32c7-4652-be72-e448219cee78 on hv-cinder-81558 Aug 05 10:33:10.578145 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-b63f9aa0-22be-43ed-8838-969813e7c385 req-8de583e6-d4bb-4961-b330-5a900ad8db26 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035842 Aug 05 10:33:10.578938 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 421/859] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:33:10.615573 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d7243d9c-2cbc-49ba-9c48-4f375339d91c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:10.616091 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d7243d9c-2cbc-49ba-9c48-4f375339d91c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:10.622400 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d7243d9c-2cbc-49ba-9c48-4f375339d91c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:10.622888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d7243d9c-2cbc-49ba-9c48-4f375339d91c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:10.623729 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d7243d9c-2cbc-49ba-9c48-4f375339d91c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:10.624437 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d7243d9c-2cbc-49ba-9c48-4f375339d91c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:10.625062 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d7243d9c-2cbc-49ba-9c48-4f375339d91c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:10.625492 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d7243d9c-2cbc-49ba-9c48-4f375339d91c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:10.697235 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d7243d9c-2cbc-49ba-9c48-4f375339d91c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:10.705274 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d7243d9c-2cbc-49ba-9c48-4f375339d91c tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 200 len: 1464 microversion: 2.1 time: 0.093697 Aug 05 10:33:10.705969 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 439/860] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:10 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 1464 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:11.441695 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-fece50e7-411a-44af-bb6d-480f4ddc02c5 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:11.442334 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-fece50e7-411a-44af-bb6d-480f4ddc02c5 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:11.449008 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fece50e7-411a-44af-bb6d-480f4ddc02c5 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:11.449488 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fece50e7-411a-44af-bb6d-480f4ddc02c5 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:11.449917 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fece50e7-411a-44af-bb6d-480f4ddc02c5 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:11.450600 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fece50e7-411a-44af-bb6d-480f4ddc02c5 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:11.451110 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fece50e7-411a-44af-bb6d-480f4ddc02c5 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:11.451532 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fece50e7-411a-44af-bb6d-480f4ddc02c5 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:11.589227 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-fece50e7-411a-44af-bb6d-480f4ddc02c5 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:11.597534 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-fece50e7-411a-44af-bb6d-480f4ddc02c5 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1568 microversion: 2.1 time: 0.160478 Aug 05 10:33:11.598111 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 422/861] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:11 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:11.727946 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c28503f3-728f-4a70-8152-5d423531de31 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:11.728723 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c28503f3-728f-4a70-8152-5d423531de31 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 3d6b3944-32c7-4652-be72-e448219cee78] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:11.736712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c28503f3-728f-4a70-8152-5d423531de31 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:11.737195 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c28503f3-728f-4a70-8152-5d423531de31 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:11.737627 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c28503f3-728f-4a70-8152-5d423531de31 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:11.738322 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c28503f3-728f-4a70-8152-5d423531de31 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:11.738776 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c28503f3-728f-4a70-8152-5d423531de31 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:11.739232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c28503f3-728f-4a70-8152-5d423531de31 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:11.752863 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-c28503f3-728f-4a70-8152-5d423531de31 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] HTTP exception thrown: Instance 3d6b3944-32c7-4652-be72-e448219cee78 could not be found. Aug 05 10:33:11.754478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c28503f3-728f-4a70-8152-5d423531de31 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Request method failure captured: Aug 05 10:33:11.754478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 HTTP/1.1 Aug 05 10:33:11.754478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:33:11.754478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:33:11.754478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:33:11.754478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:33:11.754478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:33:11.754478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:33:11.754478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:33:11.754478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:33:11.754478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PBLDFW-X3TEawahF022LKFEKV68Ad6QHuGA8zjD7iptWxegCnn7NLZ93P_TTqy3qTfPaJgoXQW6RoMmhvpe8LOMj4ugeXgyBba8RW5T7FaRUqiQbD8fVKZKJ6l7h0zXL8SVOmIKhkBmKk6oIc4sQHq4LfBFKZWadDD9oZ1zaftUols Aug 05 10:33:11.754478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:33:11.754478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:33:11.754478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:33:11.754478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:33:11.754478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:33:11.754478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:33:11.754478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 9ea83951557a48fcaab832aea2273453 Aug 05 10:33:11.754478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-739497926 Aug 05 10:33:11.754478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:33:11.754478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:33:11.755865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9ea83951557a48fcaab832aea2273453"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9ea83951557a48fcaab832aea2273453"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ea83951557a48fcaab832aea2273453"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ea83951557a48fcaab832aea2273453"}]}] Aug 05 10:33:11.755865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-ServerRescueNegativeTestJSON-739497926 Aug 05 10:33:11.755865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 9ea83951557a48fcaab832aea2273453 Aug 05 10:33:11.755865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-739497926 Aug 05 10:33:11.755865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-ServerRescueNegativeTestJSON-739497926-project Aug 05 10:33:11.755865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:33:11.755865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:33:11.755865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: a3b4d90bcfc34d2d9ba1c40316e09858 Aug 05 10:33:11.755865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-ServerRescueNegativeTestJSON-739497926-project Aug 05 10:33:11.755865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:33:11.755865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Instance 3d6b3944-32c7-4652-be72-e448219cee78 could not be found. Aug 05 10:33:11.755865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': '3d6b3944-32c7-4652-be72-e448219cee78'} Aug 05 10:33:11.756620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:33:11.756620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:33:11.756620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:33:11.756620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:33:11.756620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:33:11.756620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:33:11.756620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:33:11.756620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:33:11.756620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:33:11.756620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:33:11.756620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d6b3944-32c7-4652-be72-e448219cee78 could not be found. Aug 05 10:33:11.756620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:33:11.756620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:33:11.756620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:33:11.756620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:33:11.756620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:33:11.756620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:33:11.756620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:33:11.756620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:33:11.756620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:33:11.757947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:33:11.757947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:33:11.757947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:33:11.757947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:33:11.757947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:33:11.757947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:33:11.757947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:33:11.757947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d6b3944-32c7-4652-be72-e448219cee78 could not be found. Aug 05 10:33:11.757947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:33:11.757947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:33:11.757947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:33:11.757947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:33:11.757947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:33:11.757947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:33:11.757947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:33:11.757947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:33:11.757947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d6b3944-32c7-4652-be72-e448219cee78 could not be found. Aug 05 10:33:11.757947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:33:11.759253 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c28503f3-728f-4a70-8152-5d423531de31 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Returning 404 to user: Instance 3d6b3944-32c7-4652-be72-e448219cee78 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:33:11.759253 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c28503f3-728f-4a70-8152-5d423531de31 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78" status: 404 len: 111 microversion: 2.1 time: 0.032889 Aug 05 10:33:11.759253 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 440/862] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:11 2022] GET /compute/v2.1/servers/3d6b3944-32c7-4652-be72-e448219cee78 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:33:11.764546 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c680dca9-3dcf-435c-ac2e-ede0c0e26d21 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:11.765043 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c680dca9-3dcf-435c-ac2e-ede0c0e26d21 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:11.771663 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c680dca9-3dcf-435c-ac2e-ede0c0e26d21 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:11.772166 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c680dca9-3dcf-435c-ac2e-ede0c0e26d21 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:11.772597 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c680dca9-3dcf-435c-ac2e-ede0c0e26d21 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:11.773280 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c680dca9-3dcf-435c-ac2e-ede0c0e26d21 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:11.773726 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c680dca9-3dcf-435c-ac2e-ede0c0e26d21 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:11.774487 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c680dca9-3dcf-435c-ac2e-ede0c0e26d21 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:11.800179 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c680dca9-3dcf-435c-ac2e-ede0c0e26d21 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Going to try to terminate instance {{(pid=117831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 10:33:11.883124 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c680dca9-3dcf-435c-ac2e-ede0c0e26d21 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 204 len: 0 microversion: 2.1 time: 0.122176 Aug 05 10:33:11.883704 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 423/863] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:33:11 2022] DELETE /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:33:11.892276 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c97d2b33-5073-46db-a85c-c4ba14df60ba tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:11.892924 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c97d2b33-5073-46db-a85c-c4ba14df60ba tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:11.899429 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c97d2b33-5073-46db-a85c-c4ba14df60ba tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:11.899909 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c97d2b33-5073-46db-a85c-c4ba14df60ba tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:11.900375 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c97d2b33-5073-46db-a85c-c4ba14df60ba tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:11.901058 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c97d2b33-5073-46db-a85c-c4ba14df60ba tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:11.901504 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c97d2b33-5073-46db-a85c-c4ba14df60ba tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:11.901920 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c97d2b33-5073-46db-a85c-c4ba14df60ba tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:12.041426 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c97d2b33-5073-46db-a85c-c4ba14df60ba tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:12.049301 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c97d2b33-5073-46db-a85c-c4ba14df60ba tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1522 microversion: 2.1 time: 0.161122 Aug 05 10:33:12.049863 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 441/864] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:11 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:12.624330 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-3740f30d-7d37-49ef-a72b-1c9211299258 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:12.626199 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-3740f30d-7d37-49ef-a72b-1c9211299258 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:12.636478 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3740f30d-7d37-49ef-a72b-1c9211299258 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:12.637284 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3740f30d-7d37-49ef-a72b-1c9211299258 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:12.638008 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3740f30d-7d37-49ef-a72b-1c9211299258 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:12.639203 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3740f30d-7d37-49ef-a72b-1c9211299258 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:12.639976 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3740f30d-7d37-49ef-a72b-1c9211299258 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:12.641150 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3740f30d-7d37-49ef-a72b-1c9211299258 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:12.784625 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-3740f30d-7d37-49ef-a72b-1c9211299258 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:12.792873 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-3740f30d-7d37-49ef-a72b-1c9211299258 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1568 microversion: 2.1 time: 0.176153 Aug 05 10:33:12.793416 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 424/865] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:12 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:13.072032 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dfd64624-fa6e-4ad6-97ca-43a8b4cb3f9a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:13.072769 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dfd64624-fa6e-4ad6-97ca-43a8b4cb3f9a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:13.080778 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dfd64624-fa6e-4ad6-97ca-43a8b4cb3f9a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:13.081259 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dfd64624-fa6e-4ad6-97ca-43a8b4cb3f9a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:13.081725 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dfd64624-fa6e-4ad6-97ca-43a8b4cb3f9a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:13.082416 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dfd64624-fa6e-4ad6-97ca-43a8b4cb3f9a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:13.082866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dfd64624-fa6e-4ad6-97ca-43a8b4cb3f9a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:13.083322 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dfd64624-fa6e-4ad6-97ca-43a8b4cb3f9a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:13.087407 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:33:13.221427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dfd64624-fa6e-4ad6-97ca-43a8b4cb3f9a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:13.233352 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dfd64624-fa6e-4ad6-97ca-43a8b4cb3f9a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1522 microversion: 2.1 time: 0.166025 Aug 05 10:33:13.234498 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 442/866] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:13 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:13.819519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-28cc2427-565a-4fb8-aa5d-6058ccadc2d4 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:13.820462 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-28cc2427-565a-4fb8-aa5d-6058ccadc2d4 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:13.824318 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:33:13.831269 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-28cc2427-565a-4fb8-aa5d-6058ccadc2d4 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:13.831752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-28cc2427-565a-4fb8-aa5d-6058ccadc2d4 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:13.832188 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-28cc2427-565a-4fb8-aa5d-6058ccadc2d4 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:13.832877 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-28cc2427-565a-4fb8-aa5d-6058ccadc2d4 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:13.833328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-28cc2427-565a-4fb8-aa5d-6058ccadc2d4 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:13.833748 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-28cc2427-565a-4fb8-aa5d-6058ccadc2d4 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:13.853578 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:33:13.989660 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-28cc2427-565a-4fb8-aa5d-6058ccadc2d4 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:13.997932 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-28cc2427-565a-4fb8-aa5d-6058ccadc2d4 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1568 microversion: 2.1 time: 0.185086 Aug 05 10:33:13.998494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 425/867] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:13 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:14.253931 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7b025ee6-5431-4769-970e-39b0dfaed300 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:14.254577 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7b025ee6-5431-4769-970e-39b0dfaed300 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:14.257044 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=2,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:33:14.262912 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b025ee6-5431-4769-970e-39b0dfaed300 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:14.263406 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b025ee6-5431-4769-970e-39b0dfaed300 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:14.263843 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b025ee6-5431-4769-970e-39b0dfaed300 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:14.264549 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b025ee6-5431-4769-970e-39b0dfaed300 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:14.265003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b025ee6-5431-4769-970e-39b0dfaed300 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:14.265430 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b025ee6-5431-4769-970e-39b0dfaed300 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:14.405990 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7b025ee6-5431-4769-970e-39b0dfaed300 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:14.413604 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7b025ee6-5431-4769-970e-39b0dfaed300 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1522 microversion: 2.1 time: 0.163568 Aug 05 10:33:14.414165 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 443/868] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:14 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:14.939789 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-24106d8d-6774-400a-b770-902edd7cb3b2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:14.942096 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-24106d8d-6774-400a-b770-902edd7cb3b2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:14.949373 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-24106d8d-6774-400a-b770-902edd7cb3b2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:14.950350 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-24106d8d-6774-400a-b770-902edd7cb3b2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:14.950496 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-24106d8d-6774-400a-b770-902edd7cb3b2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:14.951261 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-24106d8d-6774-400a-b770-902edd7cb3b2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:14.951765 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-24106d8d-6774-400a-b770-902edd7cb3b2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:14.952261 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-24106d8d-6774-400a-b770-902edd7cb3b2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:14.981823 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-24106d8d-6774-400a-b770-902edd7cb3b2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046708 Aug 05 10:33:14.982390 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 426/869] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 10:33:14 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 10:33:15.020140 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-162cb356-2046-4739-afe2-4e702ef68fba tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:15.020925 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-162cb356-2046-4739-afe2-4e702ef68fba tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:15.027649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-162cb356-2046-4739-afe2-4e702ef68fba tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:15.028096 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-162cb356-2046-4739-afe2-4e702ef68fba tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:15.028530 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-162cb356-2046-4739-afe2-4e702ef68fba tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:15.030073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-162cb356-2046-4739-afe2-4e702ef68fba tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:15.031363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-162cb356-2046-4739-afe2-4e702ef68fba tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:15.031816 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-162cb356-2046-4739-afe2-4e702ef68fba tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:15.046707 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-4c56a441-ff7a-4be1-9348-c20e6a4dda3b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:15.047559 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-4c56a441-ff7a-4be1-9348-c20e6a4dda3b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:15.054321 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4c56a441-ff7a-4be1-9348-c20e6a4dda3b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:15.055000 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4c56a441-ff7a-4be1-9348-c20e6a4dda3b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:15.055566 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4c56a441-ff7a-4be1-9348-c20e6a4dda3b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:15.056494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4c56a441-ff7a-4be1-9348-c20e6a4dda3b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:15.056885 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4c56a441-ff7a-4be1-9348-c20e6a4dda3b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:15.058061 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4c56a441-ff7a-4be1-9348-c20e6a4dda3b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:15.085096 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-4c56a441-ff7a-4be1-9348-c20e6a4dda3b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Going to try to terminate instance {{(pid=117831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 10:33:15.187145 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-4c56a441-ff7a-4be1-9348-c20e6a4dda3b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 204 len: 0 microversion: 2.1 time: 0.144073 Aug 05 10:33:15.188193 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 427/870] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:33:15 2022] DELETE /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 10:33:15.196669 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f2a18400-61ad-41da-89d9-fa21b6a1af0f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:15.197897 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f2a18400-61ad-41da-89d9-fa21b6a1af0f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:15.199741 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-162cb356-2046-4739-afe2-4e702ef68fba tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:15.205073 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f2a18400-61ad-41da-89d9-fa21b6a1af0f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:15.205910 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f2a18400-61ad-41da-89d9-fa21b6a1af0f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:15.206437 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f2a18400-61ad-41da-89d9-fa21b6a1af0f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:15.207324 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f2a18400-61ad-41da-89d9-fa21b6a1af0f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:15.207874 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f2a18400-61ad-41da-89d9-fa21b6a1af0f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:15.208194 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-162cb356-2046-4739-afe2-4e702ef68fba tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1568 microversion: 2.1 time: 0.192379 Aug 05 10:33:15.208507 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f2a18400-61ad-41da-89d9-fa21b6a1af0f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:15.209384 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 444/871] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:15 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:15.357961 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-2bd8835b-76a5-4379-9b06-6d59c391c159 req-bad607f2-7de7-4df5-9b72-5ffb79a13891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ffbb1e1-7319-4e06-8218-45198955c4fc", "name": "network-vif-deleted", "tag": "879cd29f-43ad-44a3-9710-970b15b11ed9"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:33:15.368775 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-2bd8835b-76a5-4379-9b06-6d59c391c159 req-bad607f2-7de7-4df5-9b72-5ffb79a13891 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:15.369242 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-2bd8835b-76a5-4379-9b06-6d59c391c159 req-bad607f2-7de7-4df5-9b72-5ffb79a13891 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:15.369654 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-2bd8835b-76a5-4379-9b06-6d59c391c159 req-bad607f2-7de7-4df5-9b72-5ffb79a13891 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:15.381216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-2bd8835b-76a5-4379-9b06-6d59c391c159 req-bad607f2-7de7-4df5-9b72-5ffb79a13891 service nova] Creating event network-vif-deleted:879cd29f-43ad-44a3-9710-970b15b11ed9 for instance 5ffbb1e1-7319-4e06-8218-45198955c4fc on hv-cinder-81558 Aug 05 10:33:15.386336 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-2bd8835b-76a5-4379-9b06-6d59c391c159 req-bad607f2-7de7-4df5-9b72-5ffb79a13891 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032026 Aug 05 10:33:15.386946 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 445/872] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:33:15.417582 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-f2a18400-61ad-41da-89d9-fa21b6a1af0f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:15.425743 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f2a18400-61ad-41da-89d9-fa21b6a1af0f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1671 microversion: 2.1 time: 0.233089 Aug 05 10:33:15.426316 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 428/873] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:15 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1671 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:33:15.434264 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1306b7ee-06ae-4921-a07a-2614ed1184d9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:15.434938 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1306b7ee-06ae-4921-a07a-2614ed1184d9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:15.441526 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1306b7ee-06ae-4921-a07a-2614ed1184d9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:15.442004 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1306b7ee-06ae-4921-a07a-2614ed1184d9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:15.442435 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1306b7ee-06ae-4921-a07a-2614ed1184d9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:15.443160 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1306b7ee-06ae-4921-a07a-2614ed1184d9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:15.443611 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1306b7ee-06ae-4921-a07a-2614ed1184d9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:15.444030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1306b7ee-06ae-4921-a07a-2614ed1184d9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:15.525969 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1306b7ee-06ae-4921-a07a-2614ed1184d9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:15.535934 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1306b7ee-06ae-4921-a07a-2614ed1184d9 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1480 microversion: 2.1 time: 0.105638 Aug 05 10:33:15.536659 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 446/874] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:15 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1480 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:16.232914 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-0bf0188c-18cb-476c-a064-1aa4a6151817 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:16.233573 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-0bf0188c-18cb-476c-a064-1aa4a6151817 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:16.242997 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0bf0188c-18cb-476c-a064-1aa4a6151817 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:16.242997 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0bf0188c-18cb-476c-a064-1aa4a6151817 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:16.242997 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0bf0188c-18cb-476c-a064-1aa4a6151817 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:16.242997 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0bf0188c-18cb-476c-a064-1aa4a6151817 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:16.243411 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0bf0188c-18cb-476c-a064-1aa4a6151817 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:16.243411 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0bf0188c-18cb-476c-a064-1aa4a6151817 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:16.384361 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-0bf0188c-18cb-476c-a064-1aa4a6151817 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:16.392705 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-0bf0188c-18cb-476c-a064-1aa4a6151817 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1568 microversion: 2.1 time: 0.166340 Aug 05 10:33:16.393310 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 429/875] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:16 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:16.447958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a282191f-3cb3-45e6-82f2-da28b4d9d6ad tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:16.448551 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a282191f-3cb3-45e6-82f2-da28b4d9d6ad tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:16.455697 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a282191f-3cb3-45e6-82f2-da28b4d9d6ad tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:16.456181 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a282191f-3cb3-45e6-82f2-da28b4d9d6ad tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:16.456615 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a282191f-3cb3-45e6-82f2-da28b4d9d6ad tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:16.457315 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a282191f-3cb3-45e6-82f2-da28b4d9d6ad tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:16.457767 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a282191f-3cb3-45e6-82f2-da28b4d9d6ad tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:16.458188 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a282191f-3cb3-45e6-82f2-da28b4d9d6ad tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:16.559505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-582c04c6-9994-4af7-869b-ebbedc5e1f90 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:16.560336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-582c04c6-9994-4af7-869b-ebbedc5e1f90 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:16.567257 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-582c04c6-9994-4af7-869b-ebbedc5e1f90 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:16.567826 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-582c04c6-9994-4af7-869b-ebbedc5e1f90 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:16.568304 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-582c04c6-9994-4af7-869b-ebbedc5e1f90 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:16.569090 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-582c04c6-9994-4af7-869b-ebbedc5e1f90 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:16.569605 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-582c04c6-9994-4af7-869b-ebbedc5e1f90 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:16.570126 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-582c04c6-9994-4af7-869b-ebbedc5e1f90 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:16.599550 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a282191f-3cb3-45e6-82f2-da28b4d9d6ad tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:16.607281 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a282191f-3cb3-45e6-82f2-da28b4d9d6ad tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1671 microversion: 2.1 time: 0.163281 Aug 05 10:33:16.608205 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 447/876] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:16 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:16.634277 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-582c04c6-9994-4af7-869b-ebbedc5e1f90 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:16.642609 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-582c04c6-9994-4af7-869b-ebbedc5e1f90 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1307 microversion: 2.1 time: 0.087129 Aug 05 10:33:16.643218 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 430/877] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:16 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1307 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:33:17.417956 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-efa7436d-6ff0-413e-88fd-dbaf845f3cc9 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:17.418817 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-efa7436d-6ff0-413e-88fd-dbaf845f3cc9 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:17.429547 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-efa7436d-6ff0-413e-88fd-dbaf845f3cc9 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:17.430348 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-efa7436d-6ff0-413e-88fd-dbaf845f3cc9 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:17.431121 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-efa7436d-6ff0-413e-88fd-dbaf845f3cc9 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:17.432250 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-efa7436d-6ff0-413e-88fd-dbaf845f3cc9 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:17.433002 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-efa7436d-6ff0-413e-88fd-dbaf845f3cc9 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:17.433697 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-efa7436d-6ff0-413e-88fd-dbaf845f3cc9 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:17.568977 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-efa7436d-6ff0-413e-88fd-dbaf845f3cc9 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:17.576912 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-efa7436d-6ff0-413e-88fd-dbaf845f3cc9 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1568 microversion: 2.1 time: 0.165550 Aug 05 10:33:17.577550 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 448/878] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:17 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:17.628962 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d4e217f1-5fa2-452a-955d-fbe283e62e59 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:17.629587 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d4e217f1-5fa2-452a-955d-fbe283e62e59 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:17.638536 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d4e217f1-5fa2-452a-955d-fbe283e62e59 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:17.639055 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d4e217f1-5fa2-452a-955d-fbe283e62e59 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:17.639618 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d4e217f1-5fa2-452a-955d-fbe283e62e59 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:17.640445 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d4e217f1-5fa2-452a-955d-fbe283e62e59 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:17.640894 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d4e217f1-5fa2-452a-955d-fbe283e62e59 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:17.641451 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d4e217f1-5fa2-452a-955d-fbe283e62e59 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:17.665220 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6fe480d9-0f38-42cd-8399-29a01334052a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:17.665853 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6fe480d9-0f38-42cd-8399-29a01334052a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:17.673833 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fe480d9-0f38-42cd-8399-29a01334052a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:17.674403 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fe480d9-0f38-42cd-8399-29a01334052a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:17.674832 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fe480d9-0f38-42cd-8399-29a01334052a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:17.675795 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fe480d9-0f38-42cd-8399-29a01334052a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:17.676453 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fe480d9-0f38-42cd-8399-29a01334052a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:17.676868 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fe480d9-0f38-42cd-8399-29a01334052a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:17.708180 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fe480d9-0f38-42cd-8399-29a01334052a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:17.708652 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fe480d9-0f38-42cd-8399-29a01334052a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:17.709078 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fe480d9-0f38-42cd-8399-29a01334052a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:17.709722 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-6fe480d9-0f38-42cd-8399-29a01334052a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lazy-loading 'fault' on Instance uuid 5ffbb1e1-7319-4e06-8218-45198955c4fc {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:33:17.750760 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6fe480d9-0f38-42cd-8399-29a01334052a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b4d90bcfc34d2d9ba1c40316e09858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea83951557a48fcaab832aea2273453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:17.758569 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6fe480d9-0f38-42cd-8399-29a01334052a tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 200 len: 1312 microversion: 2.1 time: 0.097527 Aug 05 10:33:17.759182 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 449/879] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:17 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:17.776305 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d4e217f1-5fa2-452a-955d-fbe283e62e59 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:17.784503 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d4e217f1-5fa2-452a-955d-fbe283e62e59 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1671 microversion: 2.1 time: 0.159635 Aug 05 10:33:17.785105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 431/880] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:17 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:18.601737 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-68aa6b08-2065-487c-9e70-db344899197f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:18.602374 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-68aa6b08-2065-487c-9e70-db344899197f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:18.609606 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-68aa6b08-2065-487c-9e70-db344899197f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:18.610091 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-68aa6b08-2065-487c-9e70-db344899197f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:18.610517 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-68aa6b08-2065-487c-9e70-db344899197f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:18.611315 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-68aa6b08-2065-487c-9e70-db344899197f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:18.611766 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-68aa6b08-2065-487c-9e70-db344899197f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:18.612185 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-68aa6b08-2065-487c-9e70-db344899197f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:18.761380 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-68aa6b08-2065-487c-9e70-db344899197f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:18.772200 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-68aa6b08-2065-487c-9e70-db344899197f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1568 microversion: 2.1 time: 0.173879 Aug 05 10:33:18.773507 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 450/881] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:18 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:18.781857 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-7d39144f-18b4-45c5-8b72-b27619e78684 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:18.783318 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-7d39144f-18b4-45c5-8b72-b27619e78684 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] [instance: 5ffbb1e1-7319-4e06-8218-45198955c4fc] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:18.795865 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7d39144f-18b4-45c5-8b72-b27619e78684 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:18.796731 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7d39144f-18b4-45c5-8b72-b27619e78684 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:18.797454 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7d39144f-18b4-45c5-8b72-b27619e78684 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:18.798405 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7d39144f-18b4-45c5-8b72-b27619e78684 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:18.799115 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7d39144f-18b4-45c5-8b72-b27619e78684 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:18.799834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7d39144f-18b4-45c5-8b72-b27619e78684 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:18.808319 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4764080e-1690-45e7-87ae-18cafdeec0ac tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:18.810198 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4764080e-1690-45e7-87ae-18cafdeec0ac tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:18.826111 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4764080e-1690-45e7-87ae-18cafdeec0ac tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:18.828017 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4764080e-1690-45e7-87ae-18cafdeec0ac tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:18.828602 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4764080e-1690-45e7-87ae-18cafdeec0ac tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:18.831857 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4764080e-1690-45e7-87ae-18cafdeec0ac tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:18.833155 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4764080e-1690-45e7-87ae-18cafdeec0ac tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:18.834753 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4764080e-1690-45e7-87ae-18cafdeec0ac tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:18.858575 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-7d39144f-18b4-45c5-8b72-b27619e78684 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] HTTP exception thrown: Instance 5ffbb1e1-7319-4e06-8218-45198955c4fc could not be found. Aug 05 10:33:18.864070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-7d39144f-18b4-45c5-8b72-b27619e78684 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Request method failure captured: Aug 05 10:33:18.864070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc HTTP/1.1 Aug 05 10:33:18.864070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:33:18.864070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:33:18.864070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:33:18.864070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:33:18.864070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:33:18.864070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:33:18.864070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:33:18.864070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:33:18.864070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PBLDFW-X3TEawahF022LKFEKV68Ad6QHuGA8zjD7iptWxegCnn7NLZ93P_TTqy3qTfPaJgoXQW6RoMmhvpe8LOMj4ugeXgyBba8RW5T7FaRUqiQbD8fVKZKJ6l7h0zXL8SVOmIKhkBmKk6oIc4sQHq4LfBFKZWadDD9oZ1zaftUols Aug 05 10:33:18.864070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:33:18.864070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:33:18.864070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:33:18.864070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:33:18.864070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:33:18.864070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:33:18.864070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 9ea83951557a48fcaab832aea2273453 Aug 05 10:33:18.864070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-739497926 Aug 05 10:33:18.864070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:33:18.864070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:33:18.865644 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9ea83951557a48fcaab832aea2273453"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9ea83951557a48fcaab832aea2273453"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ea83951557a48fcaab832aea2273453"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ea83951557a48fcaab832aea2273453"}]}] Aug 05 10:33:18.865644 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-ServerRescueNegativeTestJSON-739497926 Aug 05 10:33:18.865644 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 9ea83951557a48fcaab832aea2273453 Aug 05 10:33:18.865644 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-739497926 Aug 05 10:33:18.865644 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-ServerRescueNegativeTestJSON-739497926-project Aug 05 10:33:18.865644 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:33:18.865644 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:33:18.865644 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: a3b4d90bcfc34d2d9ba1c40316e09858 Aug 05 10:33:18.865644 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-ServerRescueNegativeTestJSON-739497926-project Aug 05 10:33:18.865644 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: > Aug 05 10:33:18.865644 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Instance 5ffbb1e1-7319-4e06-8218-45198955c4fc could not be found. Aug 05 10:33:18.865644 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'id': '5ffbb1e1-7319-4e06-8218-45198955c4fc'} Aug 05 10:33:18.866551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:33:18.866551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:33:18.866551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:33:18.866551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:33:18.866551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:33:18.866551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:33:18.866551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:33:18.866551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:33:18.866551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:33:18.866551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:33:18.866551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ffbb1e1-7319-4e06-8218-45198955c4fc could not be found. Aug 05 10:33:18.866551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:33:18.866551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:33:18.866551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:33:18.866551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:33:18.866551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:33:18.866551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:33:18.866551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:33:18.866551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:33:18.866551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:33:18.867852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:33:18.867852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:33:18.867852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:33:18.867852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:33:18.867852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:33:18.867852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:33:18.867852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:33:18.867852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ffbb1e1-7319-4e06-8218-45198955c4fc could not be found. Aug 05 10:33:18.867852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:33:18.867852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:33:18.867852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:33:18.867852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:33:18.867852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:33:18.867852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:33:18.867852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:33:18.867852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:33:18.867852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ffbb1e1-7319-4e06-8218-45198955c4fc could not be found. Aug 05 10:33:18.867852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:33:18.871359 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-7d39144f-18b4-45c5-8b72-b27619e78684 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] Returning 404 to user: Instance 5ffbb1e1-7319-4e06-8218-45198955c4fc could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:33:18.873171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-7d39144f-18b4-45c5-8b72-b27619e78684 tempest-ServerRescueNegativeTestJSON-739497926 tempest-ServerRescueNegativeTestJSON-739497926-project] 10.222.0.40 "GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc" status: 404 len: 111 microversion: 2.1 time: 0.095973 Aug 05 10:33:18.874661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 432/882] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:18 2022] GET /compute/v2.1/servers/5ffbb1e1-7319-4e06-8218-45198955c4fc => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:33:18.933760 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-12372585-0f71-448e-9b15-e96bbe68c33d req-dcc5a93a-de42-4398-ae96-b3ec7665f3e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b987816b-37ef-46a2-b94e-5c3954662b58", "name": "network-vif-unplugged", "status": "completed", "tag": "b38f7bd7-6d1e-4b76-8780-abac7a1bd11a"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:33:18.948759 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-12372585-0f71-448e-9b15-e96bbe68c33d req-dcc5a93a-de42-4398-ae96-b3ec7665f3e7 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:18.949753 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-12372585-0f71-448e-9b15-e96bbe68c33d req-dcc5a93a-de42-4398-ae96-b3ec7665f3e7 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:18.950390 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-12372585-0f71-448e-9b15-e96bbe68c33d req-dcc5a93a-de42-4398-ae96-b3ec7665f3e7 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:18.967889 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-12372585-0f71-448e-9b15-e96bbe68c33d req-dcc5a93a-de42-4398-ae96-b3ec7665f3e7 service nova] Creating event network-vif-unplugged:b38f7bd7-6d1e-4b76-8780-abac7a1bd11a for instance b987816b-37ef-46a2-b94e-5c3954662b58 on hv-cinder-81558 Aug 05 10:33:18.975107 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-12372585-0f71-448e-9b15-e96bbe68c33d req-dcc5a93a-de42-4398-ae96-b3ec7665f3e7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044986 Aug 05 10:33:18.976433 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 433/883] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:33:19.070557 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4764080e-1690-45e7-87ae-18cafdeec0ac tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:19.082394 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4764080e-1690-45e7-87ae-18cafdeec0ac tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1671 microversion: 2.1 time: 0.279320 Aug 05 10:33:19.090980 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 451/884] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:18 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1671 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:19.442399 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-abb666db-4664-486b-a42f-80a7545ba659 req-149305ea-348a-4727-bd3e-e809bbadf80d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cef9d70-01bd-4d04-829d-2495d889f34a", "name": "network-vif-deleted", "tag": "7375bfe2-586c-4ea8-9eaf-e4a40b7c68d9"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:33:19.452254 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-abb666db-4664-486b-a42f-80a7545ba659 req-149305ea-348a-4727-bd3e-e809bbadf80d service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:19.452789 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-abb666db-4664-486b-a42f-80a7545ba659 req-149305ea-348a-4727-bd3e-e809bbadf80d service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:19.453212 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-abb666db-4664-486b-a42f-80a7545ba659 req-149305ea-348a-4727-bd3e-e809bbadf80d service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:19.464315 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-abb666db-4664-486b-a42f-80a7545ba659 req-149305ea-348a-4727-bd3e-e809bbadf80d service nova] Creating event network-vif-deleted:7375bfe2-586c-4ea8-9eaf-e4a40b7c68d9 for instance 6cef9d70-01bd-4d04-829d-2495d889f34a on hv-cinder-81558 Aug 05 10:33:19.469266 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-abb666db-4664-486b-a42f-80a7545ba659 req-149305ea-348a-4727-bd3e-e809bbadf80d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033453 Aug 05 10:33:19.472884 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 434/885] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:33:19.801588 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e1c22037-1258-4ffc-8b69-cc4bc2f1a22f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:19.803003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e1c22037-1258-4ffc-8b69-cc4bc2f1a22f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:19.810057 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e1c22037-1258-4ffc-8b69-cc4bc2f1a22f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:19.811252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e1c22037-1258-4ffc-8b69-cc4bc2f1a22f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:19.813230 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e1c22037-1258-4ffc-8b69-cc4bc2f1a22f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:19.814703 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e1c22037-1258-4ffc-8b69-cc4bc2f1a22f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:19.815549 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e1c22037-1258-4ffc-8b69-cc4bc2f1a22f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:19.816243 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e1c22037-1258-4ffc-8b69-cc4bc2f1a22f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:20.113553 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-26622bea-cd58-4176-9191-e8ff408aa8dd tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:20.114302 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-26622bea-cd58-4176-9191-e8ff408aa8dd tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:20.122681 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-26622bea-cd58-4176-9191-e8ff408aa8dd tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:20.123071 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-26622bea-cd58-4176-9191-e8ff408aa8dd tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:20.123581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-26622bea-cd58-4176-9191-e8ff408aa8dd tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:20.124404 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-26622bea-cd58-4176-9191-e8ff408aa8dd tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:20.124987 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-26622bea-cd58-4176-9191-e8ff408aa8dd tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:20.125640 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-26622bea-cd58-4176-9191-e8ff408aa8dd tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:20.176057 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-26622bea-cd58-4176-9191-e8ff408aa8dd tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:20.176549 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-26622bea-cd58-4176-9191-e8ff408aa8dd tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:20.176994 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-26622bea-cd58-4176-9191-e8ff408aa8dd tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:20.177461 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.objects.instance [None req-26622bea-cd58-4176-9191-e8ff408aa8dd tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lazy-loading 'fault' on Instance uuid 6cef9d70-01bd-4d04-829d-2495d889f34a {{(pid=117831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:33:20.231649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e1c22037-1258-4ffc-8b69-cc4bc2f1a22f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:20.235041 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-26622bea-cd58-4176-9191-e8ff408aa8dd tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:20.240620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e1c22037-1258-4ffc-8b69-cc4bc2f1a22f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1509 microversion: 2.1 time: 0.443882 Aug 05 10:33:20.241844 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 452/886] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:19 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1509 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:20.244523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-26622bea-cd58-4176-9191-e8ff408aa8dd tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 200 len: 1327 microversion: 2.1 time: 0.144209 Aug 05 10:33:20.245093 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 435/887] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:20 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 1327 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:20.266512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-59c4ac42-1f87-4bed-bde9-08479280d203 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:33:20.267500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-59c4ac42-1f87-4bed-bde9-08479280d203 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:20.274591 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-59c4ac42-1f87-4bed-bde9-08479280d203 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:20.275505 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-59c4ac42-1f87-4bed-bde9-08479280d203 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:20.276151 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-59c4ac42-1f87-4bed-bde9-08479280d203 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:20.277180 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-59c4ac42-1f87-4bed-bde9-08479280d203 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:20.278429 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-59c4ac42-1f87-4bed-bde9-08479280d203 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:20.284458 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-59c4ac42-1f87-4bed-bde9-08479280d203 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:20.318338 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-59c4ac42-1f87-4bed-bde9-08479280d203 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117832) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 10:33:20.405082 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-59c4ac42-1f87-4bed-bde9-08479280d203 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "POST /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58/action" status: 202 len: 0 microversion: 2.1 time: 0.143503 Aug 05 10:33:20.406586 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 453/888] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 5 10:33:20 2022] POST /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:33:20.414943 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-8ac5d31d-d9dc-4b3e-9b2b-bb910ba7763f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:20.415548 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-8ac5d31d-d9dc-4b3e-9b2b-bb910ba7763f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:20.422777 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8ac5d31d-d9dc-4b3e-9b2b-bb910ba7763f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:20.423281 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8ac5d31d-d9dc-4b3e-9b2b-bb910ba7763f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:20.423717 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8ac5d31d-d9dc-4b3e-9b2b-bb910ba7763f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:20.424432 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8ac5d31d-d9dc-4b3e-9b2b-bb910ba7763f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:20.424885 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8ac5d31d-d9dc-4b3e-9b2b-bb910ba7763f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:20.425305 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8ac5d31d-d9dc-4b3e-9b2b-bb910ba7763f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:20.655159 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-8ac5d31d-d9dc-4b3e-9b2b-bb910ba7763f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:20.665803 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-8ac5d31d-d9dc-4b3e-9b2b-bb910ba7763f tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1517 microversion: 2.1 time: 0.253786 Aug 05 10:33:20.666931 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 436/889] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:20 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1517 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:21.266721 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d0b4f570-a915-451e-9820-ce9eebbb9f21 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:21.267536 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d0b4f570-a915-451e-9820-ce9eebbb9f21 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:21.275236 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d0b4f570-a915-451e-9820-ce9eebbb9f21 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:21.275726 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d0b4f570-a915-451e-9820-ce9eebbb9f21 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:21.276166 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d0b4f570-a915-451e-9820-ce9eebbb9f21 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:21.276874 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d0b4f570-a915-451e-9820-ce9eebbb9f21 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:21.277332 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d0b4f570-a915-451e-9820-ce9eebbb9f21 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:21.277751 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d0b4f570-a915-451e-9820-ce9eebbb9f21 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:21.309436 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-d0b4f570-a915-451e-9820-ce9eebbb9f21 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] HTTP exception thrown: Instance 6cef9d70-01bd-4d04-829d-2495d889f34a could not be found. Aug 05 10:33:21.316858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d0b4f570-a915-451e-9820-ce9eebbb9f21 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Request method failure captured: Aug 05 10:33:21.316858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a HTTP/1.1 Aug 05 10:33:21.316858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:33:21.316858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:33:21.316858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:33:21.316858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:33:21.316858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:33:21.316858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:33:21.316858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:33:21.316858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:33:21.316858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PBVvKEAgXr09AeP8_YyDN_3Qg97MKcRPfZfBv7XPmAMY6XGbdZkao3LWiN6xJSWxQo0C3sWAoUgAiuk9TXnxRXxqF632u9O-sRLYlUKqbNv6LTvL8-V362JLe2HbL5YUpqikP3hRhQT8BF6T22y6WTFPUrTUTtXvezcNTjWvs0YxMM Aug 05 10:33:21.316858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:33:21.316858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:33:21.316858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:33:21.316858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:33:21.316858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:33:21.316858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:33:21.316858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 40807f4af05048deae68cf3515433261 Aug 05 10:33:21.316858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeTestJSON-1698462425 Aug 05 10:33:21.316858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:33:21.316858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:33:21.319136 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_40807f4af05048deae68cf3515433261"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/40807f4af05048deae68cf3515433261"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40807f4af05048deae68cf3515433261"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40807f4af05048deae68cf3515433261"}]}] Aug 05 10:33:21.319136 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeTestJSON-1698462425 Aug 05 10:33:21.319136 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 40807f4af05048deae68cf3515433261 Aug 05 10:33:21.319136 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1698462425 Aug 05 10:33:21.319136 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeTestJSON-1698462425-project Aug 05 10:33:21.319136 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:33:21.319136 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:33:21.319136 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: 7e7eb355fac04252a4be1f8e60037924 Aug 05 10:33:21.319136 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeTestJSON-1698462425-project Aug 05 10:33:21.319136 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:33:21.319136 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Instance 6cef9d70-01bd-4d04-829d-2495d889f34a could not be found. Aug 05 10:33:21.319136 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': '6cef9d70-01bd-4d04-829d-2495d889f34a'} Aug 05 10:33:21.320016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:33:21.320016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:33:21.320016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:33:21.320016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:33:21.320016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:33:21.320016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:33:21.320016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:33:21.320016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:33:21.320016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:33:21.320016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:33:21.320016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cef9d70-01bd-4d04-829d-2495d889f34a could not be found. Aug 05 10:33:21.320016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:33:21.320016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:33:21.320016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:33:21.320016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:33:21.320016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:33:21.320016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:33:21.320016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:33:21.320016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:33:21.320016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:33:21.321580 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:33:21.321580 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:33:21.321580 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:33:21.321580 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:33:21.321580 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:33:21.321580 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:33:21.321580 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:33:21.321580 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cef9d70-01bd-4d04-829d-2495d889f34a could not be found. Aug 05 10:33:21.321580 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:33:21.321580 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:33:21.321580 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:33:21.321580 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:33:21.321580 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:33:21.321580 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:33:21.321580 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:33:21.321580 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:33:21.321580 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cef9d70-01bd-4d04-829d-2495d889f34a could not be found. Aug 05 10:33:21.321580 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:33:21.324759 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d0b4f570-a915-451e-9820-ce9eebbb9f21 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Returning 404 to user: Instance 6cef9d70-01bd-4d04-829d-2495d889f34a could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:33:21.324759 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d0b4f570-a915-451e-9820-ce9eebbb9f21 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 404 len: 111 microversion: 2.1 time: 0.060037 Aug 05 10:33:21.324759 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 454/890] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:21 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:33:21.334138 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-36ca1e16-a147-4704-8625-0fd545cc1770 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '.version_select at 0x7f7327597dc0>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:21.358395 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-36ca1e16-a147-4704-8625-0fd545cc1770 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-338874364" status: 202 len: 0 microversion: 2.1 time: 0.027974 Aug 05 10:33:21.376627 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 437/891] 10.222.0.40 () {58 vars in 1218 bytes} [Fri Aug 5 10:33:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-338874364 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:33:21.687801 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8db6d1e9-7ebc-42b2-b73c-7046ba24b108 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:21.688954 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8db6d1e9-7ebc-42b2-b73c-7046ba24b108 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:21.700652 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8db6d1e9-7ebc-42b2-b73c-7046ba24b108 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:21.701152 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8db6d1e9-7ebc-42b2-b73c-7046ba24b108 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:21.701591 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8db6d1e9-7ebc-42b2-b73c-7046ba24b108 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:21.703654 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8db6d1e9-7ebc-42b2-b73c-7046ba24b108 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:21.704084 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8db6d1e9-7ebc-42b2-b73c-7046ba24b108 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:21.706369 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8db6d1e9-7ebc-42b2-b73c-7046ba24b108 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:21.988940 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8db6d1e9-7ebc-42b2-b73c-7046ba24b108 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:21.996685 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8db6d1e9-7ebc-42b2-b73c-7046ba24b108 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1519 microversion: 2.1 time: 0.313056 Aug 05 10:33:21.997437 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 455/892] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:21 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1519 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:22.242204 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-7e0c56b4-3bfe-4626-8291-b6370e083f98 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Action: 'create', calling method: .version_select at 0x7f73275c9940>, body: {"keypair": {"name": "tempest-keypair-603017824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYna52k+Onf0hooDAslOdSQKoSTBW6fWltFjDq/uw4F7GArTmHMWOLyuhh+tJrtmOb3SeQPvYp+npymSzJR/LVJljMEFAzK5wrqRb7tzQxDBx9XhzCxgjoy3NqNv8hamw=="}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:33:22.274297 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-7e0c56b4-3bfe-4626-8291-b6370e083f98 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Getting quotas for project 40807f4af05048deae68cf3515433261. Resources: {'key_pairs'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:33:22.278740 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-7e0c56b4-3bfe-4626-8291-b6370e083f98 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Getting quotas for user 7e7eb355fac04252a4be1f8e60037924 and project 40807f4af05048deae68cf3515433261. Resources: {'key_pairs'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:33:22.311530 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-7e0c56b4-3bfe-4626-8291-b6370e083f98 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.073240 Aug 05 10:33:22.313040 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 438/893] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 5 10:33:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:33:23.019633 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a6c5bc13-427c-432e-98dc-ee74e378ef90 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:23.020387 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a6c5bc13-427c-432e-98dc-ee74e378ef90 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:23.037216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6c5bc13-427c-432e-98dc-ee74e378ef90 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:23.037834 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6c5bc13-427c-432e-98dc-ee74e378ef90 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:23.038279 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6c5bc13-427c-432e-98dc-ee74e378ef90 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:23.039029 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6c5bc13-427c-432e-98dc-ee74e378ef90 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:23.039486 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6c5bc13-427c-432e-98dc-ee74e378ef90 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:23.040040 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6c5bc13-427c-432e-98dc-ee74e378ef90 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:23.203446 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a6c5bc13-427c-432e-98dc-ee74e378ef90 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:23.211671 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a6c5bc13-427c-432e-98dc-ee74e378ef90 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1575 microversion: 2.1 time: 0.196754 Aug 05 10:33:23.212192 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 456/894] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:23 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1575 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:24.233733 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c156697c-1840-444b-96b5-c481f592b04e tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:24.234510 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c156697c-1840-444b-96b5-c481f592b04e tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:24.240972 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c156697c-1840-444b-96b5-c481f592b04e tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:24.241532 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c156697c-1840-444b-96b5-c481f592b04e tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:24.241969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c156697c-1840-444b-96b5-c481f592b04e tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:24.242698 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c156697c-1840-444b-96b5-c481f592b04e tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:24.243330 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c156697c-1840-444b-96b5-c481f592b04e tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:24.243752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c156697c-1840-444b-96b5-c481f592b04e tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:24.632553 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c156697c-1840-444b-96b5-c481f592b04e tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:24.640556 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c156697c-1840-444b-96b5-c481f592b04e tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1575 microversion: 2.1 time: 0.411367 Aug 05 10:33:24.641166 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 439/895] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:24 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1575 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:25.089106 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-20ef57da-fefe-4f51-a740-0bc6a871a566 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-982399477", "imageRef": "6163bb7c-dfd7-4fb1-a3cb-9f4818243f78", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ead70490-96c2-4cbf-9f92-222a27e84943"}], "security_groups": [{"name": "tempest-securitygroup--1069167921"}], "key_name": "tempest-keypair-603017824", "user_data": "}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:33:25.221975 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-20ef57da-fefe-4f51-a740-0bc6a871a566 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] validate_networks() for [('ead70490-96c2-4cbf-9f92-222a27e84943', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 10:33:25.662328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-9a0a10cd-75b4-41ea-8581-c4b4413a4ac9 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:25.663883 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-9a0a10cd-75b4-41ea-8581-c4b4413a4ac9 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:25.672062 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9a0a10cd-75b4-41ea-8581-c4b4413a4ac9 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:25.672770 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9a0a10cd-75b4-41ea-8581-c4b4413a4ac9 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:25.673441 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9a0a10cd-75b4-41ea-8581-c4b4413a4ac9 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:25.674302 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9a0a10cd-75b4-41ea-8581-c4b4413a4ac9 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:25.674751 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9a0a10cd-75b4-41ea-8581-c4b4413a4ac9 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:25.675230 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9a0a10cd-75b4-41ea-8581-c4b4413a4ac9 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:25.701937 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-20ef57da-fefe-4f51-a740-0bc6a871a566 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 10:33:25.702364 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-20ef57da-fefe-4f51-a740-0bc6a871a566 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 10:33:25.702837 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-20ef57da-fefe-4f51-a740-0bc6a871a566 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 10:33:25.703433 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-20ef57da-fefe-4f51-a740-0bc6a871a566 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 10:33:25.703851 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-20ef57da-fefe-4f51-a740-0bc6a871a566 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 10:33:25.712758 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20ef57da-fefe-4f51-a740-0bc6a871a566 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:25.713745 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20ef57da-fefe-4f51-a740-0bc6a871a566 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:25.714204 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20ef57da-fefe-4f51-a740-0bc6a871a566 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:25.715330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20ef57da-fefe-4f51-a740-0bc6a871a566 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:25.715949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20ef57da-fefe-4f51-a740-0bc6a871a566 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:25.716674 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20ef57da-fefe-4f51-a740-0bc6a871a566 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:25.735480 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-20ef57da-fefe-4f51-a740-0bc6a871a566 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Getting quotas for project 40807f4af05048deae68cf3515433261. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:33:25.739817 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-20ef57da-fefe-4f51-a740-0bc6a871a566 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Getting quotas for user 7e7eb355fac04252a4be1f8e60037924 and project 40807f4af05048deae68cf3515433261. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:33:25.752814 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-20ef57da-fefe-4f51-a740-0bc6a871a566 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 10:33:25.755525 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-20ef57da-fefe-4f51-a740-0bc6a871a566 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6163bb7c-dfd7-4fb1-a3cb-9f4818243f78',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 10:33:25.806630 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-20ef57da-fefe-4f51-a740-0bc6a871a566 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.721931 Aug 05 10:33:25.811010 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 457/896] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 10:33:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 10:33:25.819157 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d8029585-97ed-416b-856c-84f873271a93 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:25.819921 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d8029585-97ed-416b-856c-84f873271a93 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:25.822035 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-9a0a10cd-75b4-41ea-8581-c4b4413a4ac9 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:25.834744 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-9a0a10cd-75b4-41ea-8581-c4b4413a4ac9 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1575 microversion: 2.1 time: 0.175805 Aug 05 10:33:25.836019 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 440/897] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:25 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:25.879710 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d8029585-97ed-416b-856c-84f873271a93 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:25.887827 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d8029585-97ed-416b-856c-84f873271a93 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e" status: 200 len: 1236 microversion: 2.1 time: 0.073059 Aug 05 10:33:25.888882 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 458/898] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:25 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e => generated 1236 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:26.856490 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-04ac754f-b126-4585-8af9-bd84b641ffc3 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:26.857299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-04ac754f-b126-4585-8af9-bd84b641ffc3 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:26.864542 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-04ac754f-b126-4585-8af9-bd84b641ffc3 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:26.865158 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-04ac754f-b126-4585-8af9-bd84b641ffc3 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:26.865688 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-04ac754f-b126-4585-8af9-bd84b641ffc3 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:26.866481 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-04ac754f-b126-4585-8af9-bd84b641ffc3 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:26.867106 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-04ac754f-b126-4585-8af9-bd84b641ffc3 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:26.867769 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-04ac754f-b126-4585-8af9-bd84b641ffc3 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:26.909475 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-823e112a-dbae-489a-b8c0-8befb0ca7d9c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:26.910125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-823e112a-dbae-489a-b8c0-8befb0ca7d9c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:26.934646 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-823e112a-dbae-489a-b8c0-8befb0ca7d9c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:26.935370 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-823e112a-dbae-489a-b8c0-8befb0ca7d9c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:26.935802 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-823e112a-dbae-489a-b8c0-8befb0ca7d9c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:26.936589 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-823e112a-dbae-489a-b8c0-8befb0ca7d9c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:26.937085 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-823e112a-dbae-489a-b8c0-8befb0ca7d9c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:26.937514 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-823e112a-dbae-489a-b8c0-8befb0ca7d9c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:27.004179 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-823e112a-dbae-489a-b8c0-8befb0ca7d9c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:27.015685 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-823e112a-dbae-489a-b8c0-8befb0ca7d9c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e" status: 200 len: 1306 microversion: 2.1 time: 0.110277 Aug 05 10:33:27.016521 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 459/899] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:26 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e => generated 1306 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:27.049472 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-04ac754f-b126-4585-8af9-bd84b641ffc3 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:27.057184 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-04ac754f-b126-4585-8af9-bd84b641ffc3 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1575 microversion: 2.1 time: 0.204770 Aug 05 10:33:27.057755 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 441/900] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:26 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1575 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:28.038854 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1a862e1e-2d8a-4cbe-9419-1d4efa841582 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:28.039820 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1a862e1e-2d8a-4cbe-9419-1d4efa841582 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:28.051533 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1a862e1e-2d8a-4cbe-9419-1d4efa841582 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:28.052023 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1a862e1e-2d8a-4cbe-9419-1d4efa841582 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:28.052662 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1a862e1e-2d8a-4cbe-9419-1d4efa841582 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:28.053545 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1a862e1e-2d8a-4cbe-9419-1d4efa841582 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:28.053980 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1a862e1e-2d8a-4cbe-9419-1d4efa841582 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:28.054407 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1a862e1e-2d8a-4cbe-9419-1d4efa841582 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:28.077851 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-95849960-1080-4841-87f9-2d5010c06c86 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:28.079170 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-95849960-1080-4841-87f9-2d5010c06c86 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:28.086548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:33:28.096317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-95849960-1080-4841-87f9-2d5010c06c86 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:28.096819 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-95849960-1080-4841-87f9-2d5010c06c86 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:28.098327 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-95849960-1080-4841-87f9-2d5010c06c86 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:28.099096 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-95849960-1080-4841-87f9-2d5010c06c86 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:28.099559 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-95849960-1080-4841-87f9-2d5010c06c86 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:28.099989 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-95849960-1080-4841-87f9-2d5010c06c86 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:28.245290 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1a862e1e-2d8a-4cbe-9419-1d4efa841582 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:28.255472 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1a862e1e-2d8a-4cbe-9419-1d4efa841582 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e" status: 200 len: 1362 microversion: 2.1 time: 0.221746 Aug 05 10:33:28.256199 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 460/901] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:28 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:28.354441 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-95849960-1080-4841-87f9-2d5010c06c86 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:28.363067 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-95849960-1080-4841-87f9-2d5010c06c86 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1575 microversion: 2.1 time: 0.289321 Aug 05 10:33:28.363649 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 442/902] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:28 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1575 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:33:28.611515 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-a3e81dd5-9870-4f80-b960-9007d0c915ba req-08490ea3-0129-41b1-8657-57bf81a77583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "550ef045-da80-4060-96f5-88bfcbba7c2e", "tag": "a268db27-ea21-4b2b-9e93-ef52a61b02d0"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:33:28.622177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-a3e81dd5-9870-4f80-b960-9007d0c915ba req-08490ea3-0129-41b1-8657-57bf81a77583 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:28.622791 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-a3e81dd5-9870-4f80-b960-9007d0c915ba req-08490ea3-0129-41b1-8657-57bf81a77583 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:28.623453 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-a3e81dd5-9870-4f80-b960-9007d0c915ba req-08490ea3-0129-41b1-8657-57bf81a77583 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:28.635594 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-a3e81dd5-9870-4f80-b960-9007d0c915ba req-08490ea3-0129-41b1-8657-57bf81a77583 service nova] Creating event network-changed:a268db27-ea21-4b2b-9e93-ef52a61b02d0 for instance 550ef045-da80-4060-96f5-88bfcbba7c2e on hv-cinder-81558 Aug 05 10:33:28.640814 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-a3e81dd5-9870-4f80-b960-9007d0c915ba req-08490ea3-0129-41b1-8657-57bf81a77583 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033213 Aug 05 10:33:28.641437 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 461/903] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:33:29.281208 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-20f4899c-c597-4b8e-98c3-bf65831d3355 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:29.281767 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-20f4899c-c597-4b8e-98c3-bf65831d3355 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:29.289114 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-20f4899c-c597-4b8e-98c3-bf65831d3355 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:29.289633 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-20f4899c-c597-4b8e-98c3-bf65831d3355 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:29.290075 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-20f4899c-c597-4b8e-98c3-bf65831d3355 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:29.290833 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-20f4899c-c597-4b8e-98c3-bf65831d3355 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:29.291326 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-20f4899c-c597-4b8e-98c3-bf65831d3355 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:29.291765 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-20f4899c-c597-4b8e-98c3-bf65831d3355 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:29.386507 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bd63d963-d400-4bb9-ba63-60c1b0f8b916 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:29.387319 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bd63d963-d400-4bb9-ba63-60c1b0f8b916 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:29.396309 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bd63d963-d400-4bb9-ba63-60c1b0f8b916 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:29.396784 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bd63d963-d400-4bb9-ba63-60c1b0f8b916 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:29.397210 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bd63d963-d400-4bb9-ba63-60c1b0f8b916 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:29.397890 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bd63d963-d400-4bb9-ba63-60c1b0f8b916 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:29.398947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bd63d963-d400-4bb9-ba63-60c1b0f8b916 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:29.399373 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bd63d963-d400-4bb9-ba63-60c1b0f8b916 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:29.438867 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-20f4899c-c597-4b8e-98c3-bf65831d3355 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:29.447059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-20f4899c-c597-4b8e-98c3-bf65831d3355 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e" status: 200 len: 1362 microversion: 2.1 time: 0.171868 Aug 05 10:33:29.447625 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 443/904] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:29 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:29.545268 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bd63d963-d400-4bb9-ba63-60c1b0f8b916 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:29.553159 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bd63d963-d400-4bb9-ba63-60c1b0f8b916 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1575 microversion: 2.1 time: 0.170908 Aug 05 10:33:29.553734 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 462/905] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:29 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:30.469422 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-601f6f13-a5a2-4d70-9a77-a02bf07e4751 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:30.469994 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-601f6f13-a5a2-4d70-9a77-a02bf07e4751 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:30.477455 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-601f6f13-a5a2-4d70-9a77-a02bf07e4751 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:30.477979 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-601f6f13-a5a2-4d70-9a77-a02bf07e4751 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:30.478584 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-601f6f13-a5a2-4d70-9a77-a02bf07e4751 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:30.479321 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-601f6f13-a5a2-4d70-9a77-a02bf07e4751 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:30.479772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-601f6f13-a5a2-4d70-9a77-a02bf07e4751 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:30.480193 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-601f6f13-a5a2-4d70-9a77-a02bf07e4751 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:30.485355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:33:30.575767 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0e0b9300-1aa2-48f8-a1d0-3770d0b42bbd tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:30.576575 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0e0b9300-1aa2-48f8-a1d0-3770d0b42bbd tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:30.583821 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0e0b9300-1aa2-48f8-a1d0-3770d0b42bbd tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:30.584542 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0e0b9300-1aa2-48f8-a1d0-3770d0b42bbd tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:30.584978 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0e0b9300-1aa2-48f8-a1d0-3770d0b42bbd tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:30.585681 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0e0b9300-1aa2-48f8-a1d0-3770d0b42bbd tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:30.586136 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0e0b9300-1aa2-48f8-a1d0-3770d0b42bbd tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:30.586739 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0e0b9300-1aa2-48f8-a1d0-3770d0b42bbd tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:30.632761 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-601f6f13-a5a2-4d70-9a77-a02bf07e4751 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:30.641918 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-601f6f13-a5a2-4d70-9a77-a02bf07e4751 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e" status: 200 len: 1362 microversion: 2.1 time: 0.176918 Aug 05 10:33:30.642517 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 444/906] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:30 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:30.769201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0e0b9300-1aa2-48f8-a1d0-3770d0b42bbd tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:30.783690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0e0b9300-1aa2-48f8-a1d0-3770d0b42bbd tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1575 microversion: 2.1 time: 0.212426 Aug 05 10:33:30.784694 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 463/907] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:30 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1575 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:31.662976 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-fa44cf10-5040-4bff-929e-428461395085 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:31.663585 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-fa44cf10-5040-4bff-929e-428461395085 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:31.670022 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fa44cf10-5040-4bff-929e-428461395085 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:31.670496 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fa44cf10-5040-4bff-929e-428461395085 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:31.670931 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fa44cf10-5040-4bff-929e-428461395085 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:31.671693 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fa44cf10-5040-4bff-929e-428461395085 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:31.672415 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fa44cf10-5040-4bff-929e-428461395085 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:31.672849 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fa44cf10-5040-4bff-929e-428461395085 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:31.806640 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d687475f-962c-49d3-bcc7-a7e8d684edae tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:31.808013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d687475f-962c-49d3-bcc7-a7e8d684edae tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:31.815269 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d687475f-962c-49d3-bcc7-a7e8d684edae tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:31.818806 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-fa44cf10-5040-4bff-929e-428461395085 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:31.822537 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d687475f-962c-49d3-bcc7-a7e8d684edae tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:31.823279 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d687475f-962c-49d3-bcc7-a7e8d684edae tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:31.823840 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d687475f-962c-49d3-bcc7-a7e8d684edae tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:31.824268 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d687475f-962c-49d3-bcc7-a7e8d684edae tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:31.824687 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d687475f-962c-49d3-bcc7-a7e8d684edae tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:31.833738 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-fa44cf10-5040-4bff-929e-428461395085 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e" status: 200 len: 1362 microversion: 2.1 time: 0.174612 Aug 05 10:33:31.834945 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 445/908] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:31 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:31.979150 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d687475f-962c-49d3-bcc7-a7e8d684edae tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:31.987964 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d687475f-962c-49d3-bcc7-a7e8d684edae tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1575 microversion: 2.1 time: 0.186305 Aug 05 10:33:31.988582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 464/909] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:31 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1575 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:32.855010 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-04ed230f-a065-481d-abf2-917cdab16d4d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:32.855689 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-04ed230f-a065-481d-abf2-917cdab16d4d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:32.859216 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=4 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:33:32.864748 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-04ed230f-a065-481d-abf2-917cdab16d4d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:32.865240 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-04ed230f-a065-481d-abf2-917cdab16d4d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:32.865674 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-04ed230f-a065-481d-abf2-917cdab16d4d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:32.866375 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-04ed230f-a065-481d-abf2-917cdab16d4d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:32.867016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-04ed230f-a065-481d-abf2-917cdab16d4d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:32.867445 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-04ed230f-a065-481d-abf2-917cdab16d4d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:33.009703 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1d9dcea9-d769-4262-9a55-27327d537b14 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:33.010419 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1d9dcea9-d769-4262-9a55-27327d537b14 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:33.017418 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d9dcea9-d769-4262-9a55-27327d537b14 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:33.017893 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d9dcea9-d769-4262-9a55-27327d537b14 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:33.018317 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d9dcea9-d769-4262-9a55-27327d537b14 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:33.019028 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d9dcea9-d769-4262-9a55-27327d537b14 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:33.019471 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d9dcea9-d769-4262-9a55-27327d537b14 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:33.019717 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-04ed230f-a065-481d-abf2-917cdab16d4d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:33.019887 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d9dcea9-d769-4262-9a55-27327d537b14 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:33.027631 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-04ed230f-a065-481d-abf2-917cdab16d4d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e" status: 200 len: 1362 microversion: 2.1 time: 0.176717 Aug 05 10:33:33.028216 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 446/910] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:32 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:33.163425 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1d9dcea9-d769-4262-9a55-27327d537b14 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:33.173052 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1d9dcea9-d769-4262-9a55-27327d537b14 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1575 microversion: 2.1 time: 0.166936 Aug 05 10:33:33.173853 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 465/911] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:33 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:33:34.052834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-07fb6458-49e7-4178-a7de-ddafb64c4466 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:34.053699 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-07fb6458-49e7-4178-a7de-ddafb64c4466 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:34.061263 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-07fb6458-49e7-4178-a7de-ddafb64c4466 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:34.061907 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-07fb6458-49e7-4178-a7de-ddafb64c4466 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:34.062442 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-07fb6458-49e7-4178-a7de-ddafb64c4466 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:34.063370 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-07fb6458-49e7-4178-a7de-ddafb64c4466 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:34.063959 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-07fb6458-49e7-4178-a7de-ddafb64c4466 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:34.064529 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-07fb6458-49e7-4178-a7de-ddafb64c4466 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:34.198647 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a084f89a-a87a-4876-8cbf-a10516ef0561 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:34.199273 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a084f89a-a87a-4876-8cbf-a10516ef0561 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:34.199425 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-07fb6458-49e7-4178-a7de-ddafb64c4466 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:34.206397 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a084f89a-a87a-4876-8cbf-a10516ef0561 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:34.206876 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a084f89a-a87a-4876-8cbf-a10516ef0561 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:34.207324 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-07fb6458-49e7-4178-a7de-ddafb64c4466 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e" status: 200 len: 1362 microversion: 2.1 time: 0.162669 Aug 05 10:33:34.207435 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a084f89a-a87a-4876-8cbf-a10516ef0561 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:34.207896 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 447/912] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:34 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:34.208002 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a084f89a-a87a-4876-8cbf-a10516ef0561 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:34.208452 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a084f89a-a87a-4876-8cbf-a10516ef0561 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:34.208869 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a084f89a-a87a-4876-8cbf-a10516ef0561 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:34.343403 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a084f89a-a87a-4876-8cbf-a10516ef0561 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:34.355309 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a084f89a-a87a-4876-8cbf-a10516ef0561 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1575 microversion: 2.1 time: 0.160329 Aug 05 10:33:34.356238 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 466/913] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:34 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:35.015152 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-8a2f7701-9c88-4518-87cb-f74a9bad14a8 req-46e5856d-8dbd-47d1-aac8-ed0a3a105145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "550ef045-da80-4060-96f5-88bfcbba7c2e", "name": "network-vif-plugged", "status": "completed", "tag": "a268db27-ea21-4b2b-9e93-ef52a61b02d0"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:33:35.025147 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-8a2f7701-9c88-4518-87cb-f74a9bad14a8 req-46e5856d-8dbd-47d1-aac8-ed0a3a105145 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:35.025654 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-8a2f7701-9c88-4518-87cb-f74a9bad14a8 req-46e5856d-8dbd-47d1-aac8-ed0a3a105145 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:35.026081 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-8a2f7701-9c88-4518-87cb-f74a9bad14a8 req-46e5856d-8dbd-47d1-aac8-ed0a3a105145 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:35.038702 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-8a2f7701-9c88-4518-87cb-f74a9bad14a8 req-46e5856d-8dbd-47d1-aac8-ed0a3a105145 service nova] Creating event network-vif-plugged:a268db27-ea21-4b2b-9e93-ef52a61b02d0 for instance 550ef045-da80-4060-96f5-88bfcbba7c2e on hv-cinder-81558 Aug 05 10:33:35.043675 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-8a2f7701-9c88-4518-87cb-f74a9bad14a8 req-46e5856d-8dbd-47d1-aac8-ed0a3a105145 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033839 Aug 05 10:33:35.044492 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 448/914] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:33:35.232357 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1f7f5cf9-95a7-488d-9d5f-cde8ddc5613d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:35.232357 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1f7f5cf9-95a7-488d-9d5f-cde8ddc5613d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:35.236967 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f7f5cf9-95a7-488d-9d5f-cde8ddc5613d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:35.237566 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f7f5cf9-95a7-488d-9d5f-cde8ddc5613d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:35.238074 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f7f5cf9-95a7-488d-9d5f-cde8ddc5613d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:35.238840 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f7f5cf9-95a7-488d-9d5f-cde8ddc5613d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:35.239465 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f7f5cf9-95a7-488d-9d5f-cde8ddc5613d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:35.239997 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f7f5cf9-95a7-488d-9d5f-cde8ddc5613d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:35.378347 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f8294adb-f258-4639-adb4-21eec5831267 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:35.379191 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f8294adb-f258-4639-adb4-21eec5831267 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:35.390681 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1f7f5cf9-95a7-488d-9d5f-cde8ddc5613d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:35.397140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f8294adb-f258-4639-adb4-21eec5831267 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:35.399275 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f8294adb-f258-4639-adb4-21eec5831267 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:35.401114 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f8294adb-f258-4639-adb4-21eec5831267 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:35.401917 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f8294adb-f258-4639-adb4-21eec5831267 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:35.403272 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1f7f5cf9-95a7-488d-9d5f-cde8ddc5613d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e" status: 200 len: 1362 microversion: 2.1 time: 0.179555 Aug 05 10:33:35.403553 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f8294adb-f258-4639-adb4-21eec5831267 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:35.404004 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f8294adb-f258-4639-adb4-21eec5831267 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:35.404308 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 467/915] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:35 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:35.545764 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-f8294adb-f258-4639-adb4-21eec5831267 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:35.554583 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f8294adb-f258-4639-adb4-21eec5831267 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1575 microversion: 2.1 time: 0.181856 Aug 05 10:33:35.555334 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 449/916] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:35 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:33:36.425422 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-99281b3a-9a36-400b-95cd-2b50e9561834 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:36.426029 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-99281b3a-9a36-400b-95cd-2b50e9561834 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:36.428010 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:33:36.428692 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=8 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:33:36.435017 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99281b3a-9a36-400b-95cd-2b50e9561834 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:36.435494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99281b3a-9a36-400b-95cd-2b50e9561834 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:36.435921 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99281b3a-9a36-400b-95cd-2b50e9561834 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:36.436610 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99281b3a-9a36-400b-95cd-2b50e9561834 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:36.437142 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99281b3a-9a36-400b-95cd-2b50e9561834 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:36.437722 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99281b3a-9a36-400b-95cd-2b50e9561834 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:36.573592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-99281b3a-9a36-400b-95cd-2b50e9561834 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:36.576626 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-1045cae1-34b3-4e25-ac79-7e2b041e5baa tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:36.577279 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-1045cae1-34b3-4e25-ac79-7e2b041e5baa tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:36.582297 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-99281b3a-9a36-400b-95cd-2b50e9561834 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e" status: 200 len: 1362 microversion: 2.1 time: 0.160806 Aug 05 10:33:36.583009 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 468/917] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:36 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:36.584651 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1045cae1-34b3-4e25-ac79-7e2b041e5baa tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:36.585172 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1045cae1-34b3-4e25-ac79-7e2b041e5baa tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:36.585647 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1045cae1-34b3-4e25-ac79-7e2b041e5baa tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:36.586359 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1045cae1-34b3-4e25-ac79-7e2b041e5baa tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:36.586808 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1045cae1-34b3-4e25-ac79-7e2b041e5baa tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:36.587255 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1045cae1-34b3-4e25-ac79-7e2b041e5baa tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:36.737163 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-1045cae1-34b3-4e25-ac79-7e2b041e5baa tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:36.746076 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-1045cae1-34b3-4e25-ac79-7e2b041e5baa tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1575 microversion: 2.1 time: 0.173276 Aug 05 10:33:36.746979 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 450/918] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:36 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:33:37.074844 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-8dfd2db3-5bfd-468a-98c9-0ada64d1e9de req-a00f833a-75c5-4448-8b50-6dbb480c946c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b987816b-37ef-46a2-b94e-5c3954662b58", "name": "network-vif-plugged", "status": "completed", "tag": "b38f7bd7-6d1e-4b76-8780-abac7a1bd11a"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:33:37.086373 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8dfd2db3-5bfd-468a-98c9-0ada64d1e9de req-a00f833a-75c5-4448-8b50-6dbb480c946c service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:37.086961 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8dfd2db3-5bfd-468a-98c9-0ada64d1e9de req-a00f833a-75c5-4448-8b50-6dbb480c946c service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:37.087461 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8dfd2db3-5bfd-468a-98c9-0ada64d1e9de req-a00f833a-75c5-4448-8b50-6dbb480c946c service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:37.099578 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-8dfd2db3-5bfd-468a-98c9-0ada64d1e9de req-a00f833a-75c5-4448-8b50-6dbb480c946c service nova] Creating event network-vif-plugged:b38f7bd7-6d1e-4b76-8780-abac7a1bd11a for instance b987816b-37ef-46a2-b94e-5c3954662b58 on hv-cinder-81558 Aug 05 10:33:37.108013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-8dfd2db3-5bfd-468a-98c9-0ada64d1e9de req-a00f833a-75c5-4448-8b50-6dbb480c946c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036978 Aug 05 10:33:37.109270 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 469/919] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:33:37.603863 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-608d4efc-d141-49f1-a30d-29e17dbac2c5 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:37.604576 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-608d4efc-d141-49f1-a30d-29e17dbac2c5 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:37.611556 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-608d4efc-d141-49f1-a30d-29e17dbac2c5 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:37.612404 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-608d4efc-d141-49f1-a30d-29e17dbac2c5 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:37.612917 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-608d4efc-d141-49f1-a30d-29e17dbac2c5 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:37.613679 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-608d4efc-d141-49f1-a30d-29e17dbac2c5 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:37.614132 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-608d4efc-d141-49f1-a30d-29e17dbac2c5 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:37.614619 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-608d4efc-d141-49f1-a30d-29e17dbac2c5 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:37.769259 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bc0a7668-6b4d-4165-841e-1a96c879a7e0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:37.770076 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bc0a7668-6b4d-4165-841e-1a96c879a7e0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:37.776784 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc0a7668-6b4d-4165-841e-1a96c879a7e0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:37.777522 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc0a7668-6b4d-4165-841e-1a96c879a7e0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:37.778011 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc0a7668-6b4d-4165-841e-1a96c879a7e0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:37.778805 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc0a7668-6b4d-4165-841e-1a96c879a7e0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:37.779431 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc0a7668-6b4d-4165-841e-1a96c879a7e0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:37.779849 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc0a7668-6b4d-4165-841e-1a96c879a7e0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:37.809855 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-608d4efc-d141-49f1-a30d-29e17dbac2c5 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:37.821090 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-608d4efc-d141-49f1-a30d-29e17dbac2c5 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e" status: 200 len: 1547 microversion: 2.1 time: 0.220904 Aug 05 10:33:37.822412 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 451/920] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:37 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e => generated 1547 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:37.844082 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c6281c17-e750-41b5-8a02-3704e13ae40d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:37.844573 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c6281c17-e750-41b5-8a02-3704e13ae40d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:37.853159 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6281c17-e750-41b5-8a02-3704e13ae40d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:37.853836 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6281c17-e750-41b5-8a02-3704e13ae40d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:37.854444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6281c17-e750-41b5-8a02-3704e13ae40d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:37.855350 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6281c17-e750-41b5-8a02-3704e13ae40d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:37.855969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6281c17-e750-41b5-8a02-3704e13ae40d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:37.856647 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6281c17-e750-41b5-8a02-3704e13ae40d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:37.920531 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bc0a7668-6b4d-4165-841e-1a96c879a7e0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:37.928820 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bc0a7668-6b4d-4165-841e-1a96c879a7e0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1575 microversion: 2.1 time: 0.164525 Aug 05 10:33:37.930021 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 470/921] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:37 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:33:37.939782 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c6281c17-e750-41b5-8a02-3704e13ae40d tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101400 Aug 05 10:33:37.940912 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 452/922] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 5 10:33:37 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:33:38.949710 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0994e55a-5566-4768-8c2f-2bed823d80fc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:38.950296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0994e55a-5566-4768-8c2f-2bed823d80fc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:38.956673 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0994e55a-5566-4768-8c2f-2bed823d80fc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:38.957140 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0994e55a-5566-4768-8c2f-2bed823d80fc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:38.957772 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0994e55a-5566-4768-8c2f-2bed823d80fc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:38.958458 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0994e55a-5566-4768-8c2f-2bed823d80fc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:38.958926 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0994e55a-5566-4768-8c2f-2bed823d80fc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:38.959557 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0994e55a-5566-4768-8c2f-2bed823d80fc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:39.220956 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-6cf47c71-b1e1-40a3-a07c-0cbd6be27280 req-3d9635cd-f809-4c6b-bc74-aba59ed2f73c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "550ef045-da80-4060-96f5-88bfcbba7c2e", "tag": "a268db27-ea21-4b2b-9e93-ef52a61b02d0"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:33:39.232869 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-6cf47c71-b1e1-40a3-a07c-0cbd6be27280 req-3d9635cd-f809-4c6b-bc74-aba59ed2f73c service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:39.233851 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-6cf47c71-b1e1-40a3-a07c-0cbd6be27280 req-3d9635cd-f809-4c6b-bc74-aba59ed2f73c service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:39.234342 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-6cf47c71-b1e1-40a3-a07c-0cbd6be27280 req-3d9635cd-f809-4c6b-bc74-aba59ed2f73c service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:39.248231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-6cf47c71-b1e1-40a3-a07c-0cbd6be27280 req-3d9635cd-f809-4c6b-bc74-aba59ed2f73c service nova] Creating event network-changed:a268db27-ea21-4b2b-9e93-ef52a61b02d0 for instance 550ef045-da80-4060-96f5-88bfcbba7c2e on hv-cinder-81558 Aug 05 10:33:39.254587 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-6cf47c71-b1e1-40a3-a07c-0cbd6be27280 req-3d9635cd-f809-4c6b-bc74-aba59ed2f73c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038239 Aug 05 10:33:39.255416 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 453/923] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:33:39.306303 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0994e55a-5566-4768-8c2f-2bed823d80fc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:39.315055 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0994e55a-5566-4768-8c2f-2bed823d80fc tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1575 microversion: 2.1 time: 0.368866 Aug 05 10:33:39.315758 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 471/924] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:38 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1575 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:40.337434 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-28cbc0d1-3396-41a3-b81d-b4d242c09aab tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:40.338146 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-28cbc0d1-3396-41a3-b81d-b4d242c09aab tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:40.345275 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-28cbc0d1-3396-41a3-b81d-b4d242c09aab tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:40.345753 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-28cbc0d1-3396-41a3-b81d-b4d242c09aab tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:40.346185 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-28cbc0d1-3396-41a3-b81d-b4d242c09aab tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:40.346870 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-28cbc0d1-3396-41a3-b81d-b4d242c09aab tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:40.347383 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-28cbc0d1-3396-41a3-b81d-b4d242c09aab tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:40.347801 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-28cbc0d1-3396-41a3-b81d-b4d242c09aab tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:40.488115 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-28cbc0d1-3396-41a3-b81d-b4d242c09aab tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:33:40.496358 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-28cbc0d1-3396-41a3-b81d-b4d242c09aab tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1562 microversion: 2.1 time: 0.163739 Aug 05 10:33:40.496935 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 454/925] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:33:40 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:33:54.034555 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-edcca18e-423b-4696-a3e8-8d36e63f903d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:33:54.035140 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-edcca18e-423b-4696-a3e8-8d36e63f903d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:54.038330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:33:54.038999 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=60 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:33:54.045424 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-edcca18e-423b-4696-a3e8-8d36e63f903d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:54.045961 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-edcca18e-423b-4696-a3e8-8d36e63f903d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:54.046477 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-edcca18e-423b-4696-a3e8-8d36e63f903d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:54.047196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-edcca18e-423b-4696-a3e8-8d36e63f903d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:54.047666 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-edcca18e-423b-4696-a3e8-8d36e63f903d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:54.048074 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-edcca18e-423b-4696-a3e8-8d36e63f903d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:54.072413 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-edcca18e-423b-4696-a3e8-8d36e63f903d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70/ips" status: 200 len: 149 microversion: 2.1 time: 0.041595 Aug 05 10:33:54.072968 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 472/926] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 5 10:33:54 2022] GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:33:55.441178 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ec828009-c145-42af-8f64-99a9b2a701e3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89b4377e-9e6e-48f9-82f4-3ea0ecb92c39"}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:33:55.443846 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-ec828009-c145-42af-8f64-99a9b2a701e3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:33:55.446217 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:33:55.446864 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=54 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:33:55.452236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ec828009-c145-42af-8f64-99a9b2a701e3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:55.452697 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ec828009-c145-42af-8f64-99a9b2a701e3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:55.453122 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ec828009-c145-42af-8f64-99a9b2a701e3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:55.453799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ec828009-c145-42af-8f64-99a9b2a701e3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:33:55.454313 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ec828009-c145-42af-8f64-99a9b2a701e3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:33:55.454777 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ec828009-c145-42af-8f64-99a9b2a701e3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:33:55.770967 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ec828009-c145-42af-8f64-99a9b2a701e3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "POST /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333038 Aug 05 10:33:55.771885 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 455/927] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 10:33:55 2022] POST /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:34:03.324008 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-12dea262-5d3c-4d13-a84e-a8aa59851f5f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89b4377e-9e6e-48f9-82f4-3ea0ecb92c39"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:34:03.326314 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-12dea262-5d3c-4d13-a84e-a8aa59851f5f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:03.332718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-12dea262-5d3c-4d13-a84e-a8aa59851f5f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:03.333183 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-12dea262-5d3c-4d13-a84e-a8aa59851f5f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:03.333604 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-12dea262-5d3c-4d13-a84e-a8aa59851f5f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:03.334280 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-12dea262-5d3c-4d13-a84e-a8aa59851f5f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:03.334725 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-12dea262-5d3c-4d13-a84e-a8aa59851f5f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:03.335168 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-12dea262-5d3c-4d13-a84e-a8aa59851f5f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:03.415857 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-12dea262-5d3c-4d13-a84e-a8aa59851f5f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] HTTP exception thrown: Invalid volume: volume 89b4377e-9e6e-48f9-82f4-3ea0ecb92c39 is already attached to instances: a2ddd5d5-3966-4be6-a170-983dfa513c70 Aug 05 10:34:03.417582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-12dea262-5d3c-4d13-a84e-a8aa59851f5f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Request method failure captured: Aug 05 10:34:03.417582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: POST /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70/os-volume_attachments HTTP/1.1 Aug 05 10:34:03.417582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:34:03.417582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:34:03.417582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:34:03.417582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 74 Aug 05 10:34:03.417582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:34:03.417582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:34:03.417582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:34:03.417582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:34:03.417582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PBEs4GBOTlzHHz3GlVMvlqYVRTPVr6yfrGm0EGFVS5M35LAWkuYfM80ilZKBHnEJ38Pfkbr8nmaDnAJrpi-BzlSuGmVoFSK8TlIqOxf92-vzFhtlF5ILOctbBpl6iN-xfLgYYmkabgjeYJKmgu_f_koSkZUI4fIkuVQ5_PFB3z056g Aug 05 10:34:03.417582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:34:03.417582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:34:03.417582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:34:03.417582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:34:03.417582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:34:03.417582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:34:03.417582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:34:03.417582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:34:03.417582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:34:03.417582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:34:03.419240 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_588c79a0604e49f49123980f0e9af63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}] Aug 05 10:34:03.419240 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:34:03.419240 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:34:03.419240 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:34:03.419240 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:34:03.419240 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:34:03.419240 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:34:03.419240 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: 706dbfa719c04fd0a3704ebd7eb812cd Aug 05 10:34:03.419240 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:34:03.419240 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Aug 05 10:34:03.419240 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {"volumeAttachment": {"volumeId": "89b4377e-9e6e-48f9-82f4-3ea0ecb92c39"}} Aug 05 10:34:03.419240 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:34:03.420073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Invalid volume: volume 89b4377e-9e6e-48f9-82f4-3ea0ecb92c39 is already attached to instances: a2ddd5d5-3966-4be6-a170-983dfa513c70 Aug 05 10:34:03.420073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'server_id': 'a2ddd5d5-3966-4be6-a170-983dfa513c70', 'body': {'volumeAttachment': {'volumeId': '89b4377e-9e6e-48f9-82f4-3ea0ecb92c39'}}} Aug 05 10:34:03.420073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:34:03.420073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:34:03.420073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 10:34:03.420073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 10:34:03.420073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 10:34:03.420073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 10:34:03.420073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 05 10:34:03.420073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 05 10:34:03.420073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 05 10:34:03.420073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 05 10:34:03.420073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 05 10:34:03.420073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 05 10:34:03.420073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 89b4377e-9e6e-48f9-82f4-3ea0ecb92c39 is already attached to instances: a2ddd5d5-3966-4be6-a170-983dfa513c70 Aug 05 10:34:03.420073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:34:03.420073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:34:03.420073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:34:03.420073 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:34:03.421535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:34:03.421535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:34:03.421535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:34:03.421535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:34:03.421535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:34:03.421535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:34:03.421535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 10:34:03.421535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 10:34:03.421535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 10:34:03.421535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 10:34:03.421535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 10:34:03.421535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 10:34:03.421535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 05 10:34:03.421535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 05 10:34:03.421535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 89b4377e-9e6e-48f9-82f4-3ea0ecb92c39 is already attached to instances: a2ddd5d5-3966-4be6-a170-983dfa513c70 Aug 05 10:34:03.421535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:34:03.421535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:34:03.421535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:34:03.421535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:34:03.421535 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:34:03.423308 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:34:03.423308 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:34:03.423308 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:34:03.423308 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 89b4377e-9e6e-48f9-82f4-3ea0ecb92c39 is already attached to instances: a2ddd5d5-3966-4be6-a170-983dfa513c70 Aug 05 10:34:03.423308 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:34:03.423308 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-12dea262-5d3c-4d13-a84e-a8aa59851f5f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Returning 400 to user: Invalid volume: volume 89b4377e-9e6e-48f9-82f4-3ea0ecb92c39 is already attached to instances: a2ddd5d5-3966-4be6-a170-983dfa513c70 {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:34:03.423308 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-12dea262-5d3c-4d13-a84e-a8aa59851f5f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "POST /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099442 Aug 05 10:34:03.423308 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 473/928] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 10:34:03 2022] POST /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 10:34:03.483311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-1c56af78-cc31-4d13-a86e-48279a936f54 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:03.483883 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-1c56af78-cc31-4d13-a86e-48279a936f54 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:03.490674 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1c56af78-cc31-4d13-a86e-48279a936f54 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:03.491200 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1c56af78-cc31-4d13-a86e-48279a936f54 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:03.492129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1c56af78-cc31-4d13-a86e-48279a936f54 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:03.492775 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1c56af78-cc31-4d13-a86e-48279a936f54 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:03.493232 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1c56af78-cc31-4d13-a86e-48279a936f54 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:03.493660 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1c56af78-cc31-4d13-a86e-48279a936f54 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:03.578551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.objects.instance [None req-1c56af78-cc31-4d13-a86e-48279a936f54 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lazy-loading 'services' on Instance uuid a2ddd5d5-3966-4be6-a170-983dfa513c70 {{(pid=117831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:34:03.662991 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-1c56af78-cc31-4d13-a86e-48279a936f54 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70/os-volume_attachments/89b4377e-9e6e-48f9-82f4-3ea0ecb92c39" status: 202 len: 0 microversion: 2.1 time: 0.183276 Aug 05 10:34:03.663740 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 456/929] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 5 10:34:03 2022] DELETE /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70/os-volume_attachments/89b4377e-9e6e-48f9-82f4-3ea0ecb92c39 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:34:03.672072 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e88c5040-a394-4a62-8591-8601ab4f6da4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:03.674381 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e88c5040-a394-4a62-8591-8601ab4f6da4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:03.681703 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e88c5040-a394-4a62-8591-8601ab4f6da4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:03.682251 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e88c5040-a394-4a62-8591-8601ab4f6da4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:03.682883 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e88c5040-a394-4a62-8591-8601ab4f6da4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:03.683731 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e88c5040-a394-4a62-8591-8601ab4f6da4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:03.684160 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e88c5040-a394-4a62-8591-8601ab4f6da4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:03.684571 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e88c5040-a394-4a62-8591-8601ab4f6da4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:03.730991 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e88c5040-a394-4a62-8591-8601ab4f6da4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062673 Aug 05 10:34:03.731801 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 474/930] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 10:34:03 2022] GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:34:04.747296 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-0e0b16f1-29bc-4ba0-a73b-02a84d11febc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:04.750489 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-0e0b16f1-29bc-4ba0-a73b-02a84d11febc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:04.765339 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0e0b16f1-29bc-4ba0-a73b-02a84d11febc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:04.766024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0e0b16f1-29bc-4ba0-a73b-02a84d11febc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:04.766645 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0e0b16f1-29bc-4ba0-a73b-02a84d11febc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:04.767575 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0e0b16f1-29bc-4ba0-a73b-02a84d11febc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:04.768021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0e0b16f1-29bc-4ba0-a73b-02a84d11febc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:04.768438 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0e0b16f1-29bc-4ba0-a73b-02a84d11febc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:04.799961 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-0e0b16f1-29bc-4ba0-a73b-02a84d11febc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059244 Aug 05 10:34:04.800516 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 457/931] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 10:34:04 2022] GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 10:34:04.864994 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8309de98-2979-4629-be28-578849b4d5b5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:04.865795 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8309de98-2979-4629-be28-578849b4d5b5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:04.875529 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8309de98-2979-4629-be28-578849b4d5b5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:04.876182 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8309de98-2979-4629-be28-578849b4d5b5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:04.876812 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8309de98-2979-4629-be28-578849b4d5b5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:04.877864 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8309de98-2979-4629-be28-578849b4d5b5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:04.878518 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8309de98-2979-4629-be28-578849b4d5b5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:04.879152 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8309de98-2979-4629-be28-578849b4d5b5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:04.906008 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8309de98-2979-4629-be28-578849b4d5b5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 10:34:04.987634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8309de98-2979-4629-be28-578849b4d5b5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70" status: 204 len: 0 microversion: 2.1 time: 0.128484 Aug 05 10:34:04.988772 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 475/932] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:34:04 2022] DELETE /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:34:04.998675 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c5ac3a86-6e25-4727-9fcd-557733471468 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:04.999216 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c5ac3a86-6e25-4727-9fcd-557733471468 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:05.005845 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c5ac3a86-6e25-4727-9fcd-557733471468 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:05.006261 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c5ac3a86-6e25-4727-9fcd-557733471468 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:05.006764 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c5ac3a86-6e25-4727-9fcd-557733471468 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:05.007663 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c5ac3a86-6e25-4727-9fcd-557733471468 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:05.008454 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c5ac3a86-6e25-4727-9fcd-557733471468 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:05.009377 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c5ac3a86-6e25-4727-9fcd-557733471468 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:05.153361 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c5ac3a86-6e25-4727-9fcd-557733471468 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:05.161307 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c5ac3a86-6e25-4727-9fcd-557733471468 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70" status: 200 len: 1680 microversion: 2.1 time: 0.167646 Aug 05 10:34:05.161886 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 458/933] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:34:04 2022] GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:34:06.190032 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-951ac849-9181-461f-a666-76adb58ce731 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:06.190730 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-951ac849-9181-461f-a666-76adb58ce731 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:06.197526 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-951ac849-9181-461f-a666-76adb58ce731 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:06.198004 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-951ac849-9181-461f-a666-76adb58ce731 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:06.198556 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-951ac849-9181-461f-a666-76adb58ce731 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:06.199295 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-951ac849-9181-461f-a666-76adb58ce731 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:06.199729 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-951ac849-9181-461f-a666-76adb58ce731 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:06.200166 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-951ac849-9181-461f-a666-76adb58ce731 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:06.351042 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-951ac849-9181-461f-a666-76adb58ce731 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:06.360247 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-951ac849-9181-461f-a666-76adb58ce731 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70" status: 200 len: 1680 microversion: 2.1 time: 0.174442 Aug 05 10:34:06.360845 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 476/934] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:34:06 2022] GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:34:07.382237 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c9348b80-d601-4686-965f-9d87f6ecb2a7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:07.382994 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c9348b80-d601-4686-965f-9d87f6ecb2a7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:07.390355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c9348b80-d601-4686-965f-9d87f6ecb2a7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:07.390829 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c9348b80-d601-4686-965f-9d87f6ecb2a7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:07.391290 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c9348b80-d601-4686-965f-9d87f6ecb2a7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:07.391982 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c9348b80-d601-4686-965f-9d87f6ecb2a7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:07.392429 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c9348b80-d601-4686-965f-9d87f6ecb2a7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:07.392848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c9348b80-d601-4686-965f-9d87f6ecb2a7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:07.644198 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c9348b80-d601-4686-965f-9d87f6ecb2a7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:07.653256 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c9348b80-d601-4686-965f-9d87f6ecb2a7 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70" status: 200 len: 1680 microversion: 2.1 time: 0.274536 Aug 05 10:34:07.653909 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 459/935] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:34:07 2022] GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70 => generated 1680 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:34:08.227307 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-7e6344d6-5488-4645-b749-86792741d953 req-845d4fce-9415-475c-a55b-ea402c1f93b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ddd5d5-3966-4be6-a170-983dfa513c70", "name": "network-vif-deleted", "tag": "2667c184-bc6e-43c8-b3af-9a09678ecf6d"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:34:08.239536 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-7e6344d6-5488-4645-b749-86792741d953 req-845d4fce-9415-475c-a55b-ea402c1f93b1 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:08.240989 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-7e6344d6-5488-4645-b749-86792741d953 req-845d4fce-9415-475c-a55b-ea402c1f93b1 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:08.242048 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-7e6344d6-5488-4645-b749-86792741d953 req-845d4fce-9415-475c-a55b-ea402c1f93b1 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:08.255364 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-7e6344d6-5488-4645-b749-86792741d953 req-845d4fce-9415-475c-a55b-ea402c1f93b1 service nova] Creating event network-vif-deleted:2667c184-bc6e-43c8-b3af-9a09678ecf6d for instance a2ddd5d5-3966-4be6-a170-983dfa513c70 on hv-cinder-81558 Aug 05 10:34:08.260360 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-7e6344d6-5488-4645-b749-86792741d953 req-845d4fce-9415-475c-a55b-ea402c1f93b1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037088 Aug 05 10:34:08.261466 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 477/936] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:34:08.675796 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c6bc179e-48c0-4d61-a4cf-3d07ddea4244 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:08.676408 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c6bc179e-48c0-4d61-a4cf-3d07ddea4244 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:08.685238 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6bc179e-48c0-4d61-a4cf-3d07ddea4244 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:08.685727 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6bc179e-48c0-4d61-a4cf-3d07ddea4244 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:08.686167 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6bc179e-48c0-4d61-a4cf-3d07ddea4244 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:08.686882 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6bc179e-48c0-4d61-a4cf-3d07ddea4244 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:08.687411 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6bc179e-48c0-4d61-a4cf-3d07ddea4244 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:08.687832 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6bc179e-48c0-4d61-a4cf-3d07ddea4244 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:08.723946 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6bc179e-48c0-4d61-a4cf-3d07ddea4244 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:08.724430 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6bc179e-48c0-4d61-a4cf-3d07ddea4244 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:08.724837 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6bc179e-48c0-4d61-a4cf-3d07ddea4244 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:08.725299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.objects.instance [None req-c6bc179e-48c0-4d61-a4cf-3d07ddea4244 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lazy-loading 'fault' on Instance uuid a2ddd5d5-3966-4be6-a170-983dfa513c70 {{(pid=117831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:34:08.772443 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c6bc179e-48c0-4d61-a4cf-3d07ddea4244 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:08.782495 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c6bc179e-48c0-4d61-a4cf-3d07ddea4244 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70" status: 200 len: 1330 microversion: 2.1 time: 0.110440 Aug 05 10:34:08.783390 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 460/937] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:34:08 2022] GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70 => generated 1330 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:34:09.805287 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b9ed5105-12e4-452c-89df-d38ebe483082 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:09.805944 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b9ed5105-12e4-452c-89df-d38ebe483082 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:09.813538 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b9ed5105-12e4-452c-89df-d38ebe483082 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:09.813850 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b9ed5105-12e4-452c-89df-d38ebe483082 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:09.814280 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b9ed5105-12e4-452c-89df-d38ebe483082 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:09.814991 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b9ed5105-12e4-452c-89df-d38ebe483082 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:09.815425 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b9ed5105-12e4-452c-89df-d38ebe483082 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:09.815840 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b9ed5105-12e4-452c-89df-d38ebe483082 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:09.832013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-b9ed5105-12e4-452c-89df-d38ebe483082 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] HTTP exception thrown: Instance a2ddd5d5-3966-4be6-a170-983dfa513c70 could not be found. Aug 05 10:34:09.833409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b9ed5105-12e4-452c-89df-d38ebe483082 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Request method failure captured: Aug 05 10:34:09.833409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70 HTTP/1.1 Aug 05 10:34:09.833409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:34:09.833409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:34:09.833409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:34:09.833409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:34:09.833409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:34:09.833409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:34:09.833409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:34:09.833409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:34:09.833409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PBEs4GBOTlzHHz3GlVMvlqYVRTPVr6yfrGm0EGFVS5M35LAWkuYfM80ilZKBHnEJ38Pfkbr8nmaDnAJrpi-BzlSuGmVoFSK8TlIqOxf92-vzFhtlF5ILOctbBpl6iN-xfLgYYmkabgjeYJKmgu_f_koSkZUI4fIkuVQ5_PFB3z056g Aug 05 10:34:09.833409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:34:09.833409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:34:09.833409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:34:09.833409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:34:09.833409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:34:09.833409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:34:09.833409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:34:09.833409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:34:09.833409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:34:09.833409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:34:09.835397 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_588c79a0604e49f49123980f0e9af63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}] Aug 05 10:34:09.835397 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:34:09.835397 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:34:09.835397 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:34:09.835397 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:34:09.835397 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:34:09.835397 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:34:09.835397 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: 706dbfa719c04fd0a3704ebd7eb812cd Aug 05 10:34:09.835397 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:34:09.835397 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:34:09.835397 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Instance a2ddd5d5-3966-4be6-a170-983dfa513c70 could not be found. Aug 05 10:34:09.835397 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': 'a2ddd5d5-3966-4be6-a170-983dfa513c70'} Aug 05 10:34:09.836705 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:34:09.836705 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:34:09.836705 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:34:09.836705 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:34:09.836705 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:34:09.836705 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:34:09.836705 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:34:09.836705 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:34:09.836705 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:34:09.836705 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:34:09.836705 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2ddd5d5-3966-4be6-a170-983dfa513c70 could not be found. Aug 05 10:34:09.836705 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:34:09.836705 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:34:09.836705 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:34:09.836705 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:34:09.836705 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:34:09.836705 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:34:09.836705 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:34:09.836705 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:34:09.836705 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:34:09.838855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:34:09.838855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:34:09.838855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:34:09.838855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:34:09.838855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:34:09.838855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:34:09.838855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:34:09.838855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2ddd5d5-3966-4be6-a170-983dfa513c70 could not be found. Aug 05 10:34:09.838855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:34:09.838855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:34:09.838855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:34:09.838855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:34:09.838855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:34:09.838855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:34:09.838855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:34:09.838855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:34:09.838855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2ddd5d5-3966-4be6-a170-983dfa513c70 could not be found. Aug 05 10:34:09.838855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:34:09.840418 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b9ed5105-12e4-452c-89df-d38ebe483082 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Returning 404 to user: Instance a2ddd5d5-3966-4be6-a170-983dfa513c70 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:34:09.840418 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b9ed5105-12e4-452c-89df-d38ebe483082 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70" status: 404 len: 111 microversion: 2.1 time: 0.033893 Aug 05 10:34:09.840418 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 478/938] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:34:09 2022] GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:34:09.844642 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-e56b14be-2669-4e9d-bd58-bb654a8d98a1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '.version_select at 0x7f732750f3a0>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:09.866507 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-e56b14be-2669-4e9d-bd58-bb654a8d98a1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1069582400" status: 202 len: 0 microversion: 2.1 time: 0.026125 Aug 05 10:34:09.867288 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 461/939] 10.222.0.40 () {58 vars in 1221 bytes} [Fri Aug 5 10:34:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1069582400 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:34:10.520182 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a986aef5-494b-493f-bae2-56e2339c68c0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Action: 'create', calling method: .version_select at 0x7f73275ec670>, body: {"keypair": {"name": "tempest-keypair-916321340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFH1Q5m2YTLiXlX1ktSmALgtVWP/UXau8ITiTxoISj/DpUWF7wGkLK781OuELn/bU5A6HGtsSupbD1papUCpSuKSELo4CtRff2DPh3FJtM5ZGe631GYSqka2jDKFtIWOg=="}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:34:10.536751 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-a986aef5-494b-493f-bae2-56e2339c68c0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Getting quotas for project 588c79a0604e49f49123980f0e9af63a. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:34:10.540877 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-a986aef5-494b-493f-bae2-56e2339c68c0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Getting quotas for user 706dbfa719c04fd0a3704ebd7eb812cd and project 588c79a0604e49f49123980f0e9af63a. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:34:10.566701 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a986aef5-494b-493f-bae2-56e2339c68c0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051069 Aug 05 10:34:10.567697 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 479/940] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 5 10:34:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:34:11.969336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-080cc65a-8106-4d9a-ad39-8cf9476fb3e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1180514638", "imageRef": "6163bb7c-dfd7-4fb1-a3cb-9f4818243f78", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "35d63aef-17c7-4ac5-9809-c80ac951c47d"}], "security_groups": [{"name": "tempest-securitygroup--1351389159"}], "key_name": "tempest-keypair-916321340", "user_data": "}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:34:12.076208 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.network.neutron [None req-080cc65a-8106-4d9a-ad39-8cf9476fb3e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] validate_networks() for [('35d63aef-17c7-4ac5-9809-c80ac951c47d', None, None, None, None, None)] {{(pid=117831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 10:34:12.731148 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-080cc65a-8106-4d9a-ad39-8cf9476fb3e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Flavor limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 10:34:12.731566 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-080cc65a-8106-4d9a-ad39-8cf9476fb3e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Image limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 10:34:12.732037 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-080cc65a-8106-4d9a-ad39-8cf9476fb3e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Flavor pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 10:34:12.732436 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-080cc65a-8106-4d9a-ad39-8cf9476fb3e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Image pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 10:34:12.732844 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-080cc65a-8106-4d9a-ad39-8cf9476fb3e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 10:34:12.741997 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-080cc65a-8106-4d9a-ad39-8cf9476fb3e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:12.742480 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-080cc65a-8106-4d9a-ad39-8cf9476fb3e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:12.742933 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-080cc65a-8106-4d9a-ad39-8cf9476fb3e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:12.743674 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-080cc65a-8106-4d9a-ad39-8cf9476fb3e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:12.744112 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-080cc65a-8106-4d9a-ad39-8cf9476fb3e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:12.744548 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-080cc65a-8106-4d9a-ad39-8cf9476fb3e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:12.762227 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-080cc65a-8106-4d9a-ad39-8cf9476fb3e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Getting quotas for project 588c79a0604e49f49123980f0e9af63a. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:34:12.767717 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-080cc65a-8106-4d9a-ad39-8cf9476fb3e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Getting quotas for user 706dbfa719c04fd0a3704ebd7eb812cd and project 588c79a0604e49f49123980f0e9af63a. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:34:12.779905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-080cc65a-8106-4d9a-ad39-8cf9476fb3e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Going to run 1 instances... {{(pid=117831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 10:34:12.782750 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-080cc65a-8106-4d9a-ad39-8cf9476fb3e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6163bb7c-dfd7-4fb1-a3cb-9f4818243f78',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 10:34:12.840772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-080cc65a-8106-4d9a-ad39-8cf9476fb3e1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.876812 Aug 05 10:34:12.841581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 462/941] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 10:34:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 10:34:12.852765 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5401f324-65f7-4d9b-84c0-1110d52eb29a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:12.853404 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5401f324-65f7-4d9b-84c0-1110d52eb29a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:12.916650 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5401f324-65f7-4d9b-84c0-1110d52eb29a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:12.924250 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5401f324-65f7-4d9b-84c0-1110d52eb29a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1" status: 200 len: 1241 microversion: 2.1 time: 0.075708 Aug 05 10:34:12.935414 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 480/942] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:34:12 2022] GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:34:13.946052 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-5f786163-ef5d-47ce-b21c-568561b7f9e5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:13.947368 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-5f786163-ef5d-47ce-b21c-568561b7f9e5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:13.954883 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5f786163-ef5d-47ce-b21c-568561b7f9e5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:13.955521 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5f786163-ef5d-47ce-b21c-568561b7f9e5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:13.955953 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5f786163-ef5d-47ce-b21c-568561b7f9e5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:13.956732 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5f786163-ef5d-47ce-b21c-568561b7f9e5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:13.957187 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5f786163-ef5d-47ce-b21c-568561b7f9e5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:13.957607 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5f786163-ef5d-47ce-b21c-568561b7f9e5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:14.023068 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-5f786163-ef5d-47ce-b21c-568561b7f9e5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:14.030781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-5f786163-ef5d-47ce-b21c-568561b7f9e5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1" status: 200 len: 1293 microversion: 2.1 time: 0.089335 Aug 05 10:34:14.031515 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 463/943] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:34:13 2022] GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:34:15.053214 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f4374eb6-b49c-44d5-b4d4-ed9cbc5573b8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:15.053807 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f4374eb6-b49c-44d5-b4d4-ed9cbc5573b8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:15.060320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f4374eb6-b49c-44d5-b4d4-ed9cbc5573b8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:15.061051 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f4374eb6-b49c-44d5-b4d4-ed9cbc5573b8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:15.061706 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f4374eb6-b49c-44d5-b4d4-ed9cbc5573b8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:15.062547 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f4374eb6-b49c-44d5-b4d4-ed9cbc5573b8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:15.063078 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f4374eb6-b49c-44d5-b4d4-ed9cbc5573b8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:15.063724 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f4374eb6-b49c-44d5-b4d4-ed9cbc5573b8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:15.214549 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f4374eb6-b49c-44d5-b4d4-ed9cbc5573b8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:15.224702 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f4374eb6-b49c-44d5-b4d4-ed9cbc5573b8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1" status: 200 len: 1367 microversion: 2.1 time: 0.176572 Aug 05 10:34:15.225270 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 481/944] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:34:15 2022] GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:34:15.618367 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-7137d008-d9fa-423f-a5e5-bafd76643499 req-f30b40a3-eb39-4c7e-90a4-5d23c7889adc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b2fb523-10a3-4ff3-aa94-096ec83f9cf1", "tag": "092f9921-f266-483c-98f8-55c25728bae5"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:34:15.629819 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-7137d008-d9fa-423f-a5e5-bafd76643499 req-f30b40a3-eb39-4c7e-90a4-5d23c7889adc service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:15.630406 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-7137d008-d9fa-423f-a5e5-bafd76643499 req-f30b40a3-eb39-4c7e-90a4-5d23c7889adc service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:15.630979 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-7137d008-d9fa-423f-a5e5-bafd76643499 req-f30b40a3-eb39-4c7e-90a4-5d23c7889adc service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:15.643442 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-7137d008-d9fa-423f-a5e5-bafd76643499 req-f30b40a3-eb39-4c7e-90a4-5d23c7889adc service nova] Creating event network-changed:092f9921-f266-483c-98f8-55c25728bae5 for instance 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 on hv-cinder-81558 Aug 05 10:34:15.648939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-7137d008-d9fa-423f-a5e5-bafd76643499 req-f30b40a3-eb39-4c7e-90a4-5d23c7889adc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034418 Aug 05 10:34:15.649533 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 464/945] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:34:16.247859 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-73f6c970-f9ee-4462-8967-8e0e637699fe tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:16.248539 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-73f6c970-f9ee-4462-8967-8e0e637699fe tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:16.255563 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73f6c970-f9ee-4462-8967-8e0e637699fe tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:16.256054 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73f6c970-f9ee-4462-8967-8e0e637699fe tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:16.256487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73f6c970-f9ee-4462-8967-8e0e637699fe tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:16.257185 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73f6c970-f9ee-4462-8967-8e0e637699fe tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:16.257641 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73f6c970-f9ee-4462-8967-8e0e637699fe tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:16.258067 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73f6c970-f9ee-4462-8967-8e0e637699fe tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:16.636043 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-73f6c970-f9ee-4462-8967-8e0e637699fe tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:16.646792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-73f6c970-f9ee-4462-8967-8e0e637699fe tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1" status: 200 len: 1367 microversion: 2.1 time: 0.402851 Aug 05 10:34:16.647396 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 482/946] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:34:16 2022] GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 => generated 1367 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:34:17.679275 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-22d19b12-5c96-48c7-8976-7d01e2f713e8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:17.680314 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-22d19b12-5c96-48c7-8976-7d01e2f713e8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:17.690098 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-22d19b12-5c96-48c7-8976-7d01e2f713e8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:17.690571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-22d19b12-5c96-48c7-8976-7d01e2f713e8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:17.691036 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-22d19b12-5c96-48c7-8976-7d01e2f713e8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:17.691733 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-22d19b12-5c96-48c7-8976-7d01e2f713e8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:17.692185 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-22d19b12-5c96-48c7-8976-7d01e2f713e8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:17.692604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-22d19b12-5c96-48c7-8976-7d01e2f713e8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:17.832401 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-22d19b12-5c96-48c7-8976-7d01e2f713e8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:17.840499 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-22d19b12-5c96-48c7-8976-7d01e2f713e8 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1" status: 200 len: 1367 microversion: 2.1 time: 0.168459 Aug 05 10:34:17.841068 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 465/947] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:34:17 2022] GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:34:18.869096 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e15d7e90-0f52-417b-953d-263a78c655f4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:18.869683 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e15d7e90-0f52-417b-953d-263a78c655f4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:18.877179 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e15d7e90-0f52-417b-953d-263a78c655f4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:18.877663 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e15d7e90-0f52-417b-953d-263a78c655f4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:18.878097 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e15d7e90-0f52-417b-953d-263a78c655f4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:18.878788 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e15d7e90-0f52-417b-953d-263a78c655f4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:18.879293 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e15d7e90-0f52-417b-953d-263a78c655f4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:18.879716 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e15d7e90-0f52-417b-953d-263a78c655f4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:19.011102 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e15d7e90-0f52-417b-953d-263a78c655f4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:19.019433 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e15d7e90-0f52-417b-953d-263a78c655f4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1" status: 200 len: 1367 microversion: 2.1 time: 0.154216 Aug 05 10:34:19.020006 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 483/948] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:34:18 2022] GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:34:20.043070 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-1c380ca2-befd-4873-b5e2-373210bb3d68 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:20.043708 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-1c380ca2-befd-4873-b5e2-373210bb3d68 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:20.052669 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1c380ca2-befd-4873-b5e2-373210bb3d68 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:20.053181 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1c380ca2-befd-4873-b5e2-373210bb3d68 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:20.053618 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1c380ca2-befd-4873-b5e2-373210bb3d68 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:20.054309 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1c380ca2-befd-4873-b5e2-373210bb3d68 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:20.054758 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1c380ca2-befd-4873-b5e2-373210bb3d68 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:20.055205 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1c380ca2-befd-4873-b5e2-373210bb3d68 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:20.165803 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a3f1d932-50e2-4078-a964-d57ddb7ae08f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:20.166577 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a3f1d932-50e2-4078-a964-d57ddb7ae08f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:20.173579 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3f1d932-50e2-4078-a964-d57ddb7ae08f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:20.174136 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3f1d932-50e2-4078-a964-d57ddb7ae08f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:20.174976 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3f1d932-50e2-4078-a964-d57ddb7ae08f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:20.176227 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3f1d932-50e2-4078-a964-d57ddb7ae08f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:20.177767 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3f1d932-50e2-4078-a964-d57ddb7ae08f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:20.178545 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a3f1d932-50e2-4078-a964-d57ddb7ae08f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:20.204461 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a3f1d932-50e2-4078-a964-d57ddb7ae08f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca/ips" status: 200 len: 151 microversion: 2.20 time: 0.048850 Aug 05 10:34:20.205033 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 484/949] 10.222.0.40 () {60 vars in 1289 bytes} [Fri Aug 5 10:34:20 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca/ips => generated 151 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 10:34:20.258173 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-1c380ca2-befd-4873-b5e2-373210bb3d68 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:20.265529 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-1c380ca2-befd-4873-b5e2-373210bb3d68 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1" status: 200 len: 1367 microversion: 2.1 time: 0.228741 Aug 05 10:34:20.266103 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 466/950] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:34:20 2022] GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:34:21.286745 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fc22ebff-f19a-4032-9091-9bd7ad4e5da3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:21.287376 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fc22ebff-f19a-4032-9091-9bd7ad4e5da3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:21.294167 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc22ebff-f19a-4032-9091-9bd7ad4e5da3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:21.294648 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc22ebff-f19a-4032-9091-9bd7ad4e5da3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:21.295113 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc22ebff-f19a-4032-9091-9bd7ad4e5da3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:21.295813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc22ebff-f19a-4032-9091-9bd7ad4e5da3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:21.296261 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc22ebff-f19a-4032-9091-9bd7ad4e5da3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:21.296681 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc22ebff-f19a-4032-9091-9bd7ad4e5da3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:21.432484 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fc22ebff-f19a-4032-9091-9bd7ad4e5da3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:21.440214 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fc22ebff-f19a-4032-9091-9bd7ad4e5da3 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1" status: 200 len: 1367 microversion: 2.1 time: 0.157885 Aug 05 10:34:21.440765 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 485/951] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:34:21 2022] GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:34:22.465663 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-50cc0cb2-0985-48f0-a91b-198fcbde9302 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:22.466630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-50cc0cb2-0985-48f0-a91b-198fcbde9302 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:22.477590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-50cc0cb2-0985-48f0-a91b-198fcbde9302 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:22.478392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-50cc0cb2-0985-48f0-a91b-198fcbde9302 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:22.479177 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-50cc0cb2-0985-48f0-a91b-198fcbde9302 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:22.480322 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-50cc0cb2-0985-48f0-a91b-198fcbde9302 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:22.481075 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-50cc0cb2-0985-48f0-a91b-198fcbde9302 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:22.481785 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-50cc0cb2-0985-48f0-a91b-198fcbde9302 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:22.632990 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-50cc0cb2-0985-48f0-a91b-198fcbde9302 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:22.640593 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-50cc0cb2-0985-48f0-a91b-198fcbde9302 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1" status: 200 len: 1367 microversion: 2.1 time: 0.181650 Aug 05 10:34:22.641132 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 467/952] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:34:22 2022] GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:34:23.188785 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f6fa5028-dea5-402e-a020-e212d6874ef6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:34:23.189295 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f6fa5028-dea5-402e-a020-e212d6874ef6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:23.191846 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:34:23.197697 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6fa5028-dea5-402e-a020-e212d6874ef6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:23.198187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6fa5028-dea5-402e-a020-e212d6874ef6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:23.198638 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6fa5028-dea5-402e-a020-e212d6874ef6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:23.199384 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6fa5028-dea5-402e-a020-e212d6874ef6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:23.199893 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6fa5028-dea5-402e-a020-e212d6874ef6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:23.200318 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6fa5028-dea5-402e-a020-e212d6874ef6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:23.214843 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-cbd35a93-6e34-40bf-bfd6-b58755dc9767 req-59bdc2cf-b4b0-44fe-8bfc-25d3070a3039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b2fb523-10a3-4ff3-aa94-096ec83f9cf1", "name": "network-vif-plugged", "status": "completed", "tag": "092f9921-f266-483c-98f8-55c25728bae5"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:34:23.221072 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=2 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:34:23.222152 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=6 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:34:23.226326 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-f6fa5028-dea5-402e-a020-e212d6874ef6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lazy-loading 'flavor' on Instance uuid de6a3f62-cb68-4fa9-8c79-b99880a9e1ca {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:34:23.229175 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-cbd35a93-6e34-40bf-bfd6-b58755dc9767 req-59bdc2cf-b4b0-44fe-8bfc-25d3070a3039 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:23.229715 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-cbd35a93-6e34-40bf-bfd6-b58755dc9767 req-59bdc2cf-b4b0-44fe-8bfc-25d3070a3039 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:23.230363 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-cbd35a93-6e34-40bf-bfd6-b58755dc9767 req-59bdc2cf-b4b0-44fe-8bfc-25d3070a3039 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:23.242565 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-cbd35a93-6e34-40bf-bfd6-b58755dc9767 req-59bdc2cf-b4b0-44fe-8bfc-25d3070a3039 service nova] Creating event network-vif-plugged:092f9921-f266-483c-98f8-55c25728bae5 for instance 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 on hv-cinder-81558 Aug 05 10:34:23.247689 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-cbd35a93-6e34-40bf-bfd6-b58755dc9767 req-59bdc2cf-b4b0-44fe-8bfc-25d3070a3039 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036799 Aug 05 10:34:23.248450 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 468/953] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:34:23.425692 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f6fa5028-dea5-402e-a020-e212d6874ef6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "POST /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca/action" status: 202 len: 0 microversion: 2.20 time: 0.240367 Aug 05 10:34:23.426565 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 486/954] 10.222.0.40 () {62 vars in 1319 bytes} [Fri Aug 5 10:34:23 2022] POST /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:34:23.436523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-21a40925-9f1e-4962-9f6a-b33aaade57d9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:23.437341 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-21a40925-9f1e-4962-9f6a-b33aaade57d9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:23.443768 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-21a40925-9f1e-4962-9f6a-b33aaade57d9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:23.444297 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-21a40925-9f1e-4962-9f6a-b33aaade57d9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:23.444681 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-21a40925-9f1e-4962-9f6a-b33aaade57d9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:23.445382 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-21a40925-9f1e-4962-9f6a-b33aaade57d9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:23.446014 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-21a40925-9f1e-4962-9f6a-b33aaade57d9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:23.446494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-21a40925-9f1e-4962-9f6a-b33aaade57d9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:23.616445 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-21a40925-9f1e-4962-9f6a-b33aaade57d9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:23.624747 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-21a40925-9f1e-4962-9f6a-b33aaade57d9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:23.626230 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-21a40925-9f1e-4962-9f6a-b33aaade57d9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:23.627433 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-21a40925-9f1e-4962-9f6a-b33aaade57d9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1724 microversion: 2.20 time: 0.196415 Aug 05 10:34:23.627963 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 469/955] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:23 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:23.662611 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b69b40d7-3281-4e9e-92f8-f02bef8af531 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:23.663325 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b69b40d7-3281-4e9e-92f8-f02bef8af531 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:23.669709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b69b40d7-3281-4e9e-92f8-f02bef8af531 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:23.670177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b69b40d7-3281-4e9e-92f8-f02bef8af531 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:23.670609 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b69b40d7-3281-4e9e-92f8-f02bef8af531 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:23.671319 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b69b40d7-3281-4e9e-92f8-f02bef8af531 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:23.671763 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b69b40d7-3281-4e9e-92f8-f02bef8af531 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:23.672174 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b69b40d7-3281-4e9e-92f8-f02bef8af531 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:23.811225 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b69b40d7-3281-4e9e-92f8-f02bef8af531 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:23.822635 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b69b40d7-3281-4e9e-92f8-f02bef8af531 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1" status: 200 len: 1367 microversion: 2.1 time: 0.164156 Aug 05 10:34:23.823326 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 487/956] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:34:23 2022] GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:34:24.657079 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-5e5c300e-36ad-4644-93e6-17745a5afb83 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:24.657977 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-5e5c300e-36ad-4644-93e6-17745a5afb83 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:24.669525 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5e5c300e-36ad-4644-93e6-17745a5afb83 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:24.670326 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5e5c300e-36ad-4644-93e6-17745a5afb83 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:24.671100 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5e5c300e-36ad-4644-93e6-17745a5afb83 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:24.672258 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5e5c300e-36ad-4644-93e6-17745a5afb83 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:24.673014 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5e5c300e-36ad-4644-93e6-17745a5afb83 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:24.673717 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-5e5c300e-36ad-4644-93e6-17745a5afb83 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:24.811247 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-5e5c300e-36ad-4644-93e6-17745a5afb83 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:24.823949 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-5e5c300e-36ad-4644-93e6-17745a5afb83 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:24.826050 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-5e5c300e-36ad-4644-93e6-17745a5afb83 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:24.827837 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-5e5c300e-36ad-4644-93e6-17745a5afb83 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1724 microversion: 2.20 time: 0.177216 Aug 05 10:34:24.828587 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 470/957] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:24 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:24.845695 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f1031d66-1417-4975-bd09-ddde2260684f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:24.846301 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f1031d66-1417-4975-bd09-ddde2260684f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:24.849291 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:34:24.854349 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1031d66-1417-4975-bd09-ddde2260684f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:24.854829 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1031d66-1417-4975-bd09-ddde2260684f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:24.855309 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1031d66-1417-4975-bd09-ddde2260684f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:24.855995 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1031d66-1417-4975-bd09-ddde2260684f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:24.856441 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1031d66-1417-4975-bd09-ddde2260684f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:24.856860 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1031d66-1417-4975-bd09-ddde2260684f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:24.859966 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:34:24.998840 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f1031d66-1417-4975-bd09-ddde2260684f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:25.007839 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f1031d66-1417-4975-bd09-ddde2260684f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1" status: 200 len: 1367 microversion: 2.1 time: 0.165936 Aug 05 10:34:25.008590 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 488/958] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:34:24 2022] GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:34:25.852256 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-23e9208b-2869-4a5a-b74b-9887a4b3c4e9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:25.852879 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-23e9208b-2869-4a5a-b74b-9887a4b3c4e9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:25.855355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:34:25.861071 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-23e9208b-2869-4a5a-b74b-9887a4b3c4e9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:25.861549 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-23e9208b-2869-4a5a-b74b-9887a4b3c4e9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:25.861987 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-23e9208b-2869-4a5a-b74b-9887a4b3c4e9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:25.862653 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-23e9208b-2869-4a5a-b74b-9887a4b3c4e9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:25.863137 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-23e9208b-2869-4a5a-b74b-9887a4b3c4e9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:25.863574 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-23e9208b-2869-4a5a-b74b-9887a4b3c4e9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:25.866626 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:34:26.001331 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-23e9208b-2869-4a5a-b74b-9887a4b3c4e9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:26.009663 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-23e9208b-2869-4a5a-b74b-9887a4b3c4e9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:26.011175 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-23e9208b-2869-4a5a-b74b-9887a4b3c4e9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:26.012350 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-23e9208b-2869-4a5a-b74b-9887a4b3c4e9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1724 microversion: 2.20 time: 0.164043 Aug 05 10:34:26.013027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 471/959] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:25 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:26.032553 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f2cef053-521a-4076-96b1-c544ef302b4d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:26.033343 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f2cef053-521a-4076-96b1-c544ef302b4d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:26.039825 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2cef053-521a-4076-96b1-c544ef302b4d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:26.040302 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2cef053-521a-4076-96b1-c544ef302b4d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:26.040909 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2cef053-521a-4076-96b1-c544ef302b4d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:26.041644 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2cef053-521a-4076-96b1-c544ef302b4d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:26.042094 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2cef053-521a-4076-96b1-c544ef302b4d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:26.042512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f2cef053-521a-4076-96b1-c544ef302b4d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:26.172964 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f2cef053-521a-4076-96b1-c544ef302b4d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:26.180864 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f2cef053-521a-4076-96b1-c544ef302b4d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1" status: 200 len: 1557 microversion: 2.1 time: 0.153349 Aug 05 10:34:26.181418 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 489/960] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:34:26 2022] GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:34:26.200744 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-17a62d70-54e7-4c2f-ad6b-417757fcc166 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:26.201235 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-17a62d70-54e7-4c2f-ad6b-417757fcc166 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:26.207326 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-17a62d70-54e7-4c2f-ad6b-417757fcc166 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:26.207790 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-17a62d70-54e7-4c2f-ad6b-417757fcc166 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:26.208241 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-17a62d70-54e7-4c2f-ad6b-417757fcc166 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:26.208912 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-17a62d70-54e7-4c2f-ad6b-417757fcc166 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:26.209359 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-17a62d70-54e7-4c2f-ad6b-417757fcc166 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:26.209835 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-17a62d70-54e7-4c2f-ad6b-417757fcc166 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:26.306723 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-17a62d70-54e7-4c2f-ad6b-417757fcc166 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109722 Aug 05 10:34:26.307414 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 472/961] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 5 10:34:26 2022] GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:34:27.036593 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-706be61c-529a-48b4-ba55-692fdf2a4dd3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:27.038143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-706be61c-529a-48b4-ba55-692fdf2a4dd3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:27.046131 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-706be61c-529a-48b4-ba55-692fdf2a4dd3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:27.047129 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-706be61c-529a-48b4-ba55-692fdf2a4dd3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:27.047786 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-706be61c-529a-48b4-ba55-692fdf2a4dd3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:27.049043 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-706be61c-529a-48b4-ba55-692fdf2a4dd3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:27.049717 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-706be61c-529a-48b4-ba55-692fdf2a4dd3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:27.050575 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-706be61c-529a-48b4-ba55-692fdf2a4dd3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:27.234399 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-706be61c-529a-48b4-ba55-692fdf2a4dd3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:27.243023 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-706be61c-529a-48b4-ba55-692fdf2a4dd3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:27.244505 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-706be61c-529a-48b4-ba55-692fdf2a4dd3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:27.245746 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-706be61c-529a-48b4-ba55-692fdf2a4dd3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1724 microversion: 2.20 time: 0.213452 Aug 05 10:34:27.246301 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 490/962] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:27 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 10:34:27.569749 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-bfdaca70-6a78-4ec9-bf61-5c654ae5bceb req-8c091dd6-91d4-4be7-83f1-20c85ae22141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b2fb523-10a3-4ff3-aa94-096ec83f9cf1", "tag": "092f9921-f266-483c-98f8-55c25728bae5"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:34:27.579185 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-bfdaca70-6a78-4ec9-bf61-5c654ae5bceb req-8c091dd6-91d4-4be7-83f1-20c85ae22141 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:27.579658 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-bfdaca70-6a78-4ec9-bf61-5c654ae5bceb req-8c091dd6-91d4-4be7-83f1-20c85ae22141 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:27.580072 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-bfdaca70-6a78-4ec9-bf61-5c654ae5bceb req-8c091dd6-91d4-4be7-83f1-20c85ae22141 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:27.592157 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-bfdaca70-6a78-4ec9-bf61-5c654ae5bceb req-8c091dd6-91d4-4be7-83f1-20c85ae22141 service nova] Creating event network-changed:092f9921-f266-483c-98f8-55c25728bae5 for instance 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 on hv-cinder-81558 Aug 05 10:34:27.597261 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-bfdaca70-6a78-4ec9-bf61-5c654ae5bceb req-8c091dd6-91d4-4be7-83f1-20c85ae22141 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031791 Aug 05 10:34:27.597992 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 473/963] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:34:28.269735 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-37139ff1-d0c8-4eb5-b9eb-54c96377eded tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:28.270435 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-37139ff1-d0c8-4eb5-b9eb-54c96377eded tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:28.277554 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37139ff1-d0c8-4eb5-b9eb-54c96377eded tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:28.278126 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37139ff1-d0c8-4eb5-b9eb-54c96377eded tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:28.278589 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37139ff1-d0c8-4eb5-b9eb-54c96377eded tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:28.279331 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37139ff1-d0c8-4eb5-b9eb-54c96377eded tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:28.279816 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37139ff1-d0c8-4eb5-b9eb-54c96377eded tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:28.280234 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37139ff1-d0c8-4eb5-b9eb-54c96377eded tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:28.423129 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-37139ff1-d0c8-4eb5-b9eb-54c96377eded tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:28.432254 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-37139ff1-d0c8-4eb5-b9eb-54c96377eded tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:28.434050 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-37139ff1-d0c8-4eb5-b9eb-54c96377eded tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:28.435399 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-37139ff1-d0c8-4eb5-b9eb-54c96377eded tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1724 microversion: 2.20 time: 0.169628 Aug 05 10:34:28.435958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 491/964] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:28 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:29.460179 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-037a427c-4a12-4a1e-a404-3f777b15c299 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:29.460933 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-037a427c-4a12-4a1e-a404-3f777b15c299 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:29.469420 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-037a427c-4a12-4a1e-a404-3f777b15c299 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:29.469898 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-037a427c-4a12-4a1e-a404-3f777b15c299 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:29.470327 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-037a427c-4a12-4a1e-a404-3f777b15c299 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:29.471434 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-037a427c-4a12-4a1e-a404-3f777b15c299 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:29.472028 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-037a427c-4a12-4a1e-a404-3f777b15c299 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:29.472446 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-037a427c-4a12-4a1e-a404-3f777b15c299 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:29.617029 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-037a427c-4a12-4a1e-a404-3f777b15c299 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:29.625753 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-037a427c-4a12-4a1e-a404-3f777b15c299 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:29.627328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-037a427c-4a12-4a1e-a404-3f777b15c299 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:29.628506 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-037a427c-4a12-4a1e-a404-3f777b15c299 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1724 microversion: 2.20 time: 0.174122 Aug 05 10:34:29.629686 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 474/965] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:29 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:30.652040 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-551819d6-e560-4d44-b15e-6a535bbb67d4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:30.652626 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-551819d6-e560-4d44-b15e-6a535bbb67d4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:30.659678 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-551819d6-e560-4d44-b15e-6a535bbb67d4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:30.660146 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-551819d6-e560-4d44-b15e-6a535bbb67d4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:30.660863 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-551819d6-e560-4d44-b15e-6a535bbb67d4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:30.661572 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-551819d6-e560-4d44-b15e-6a535bbb67d4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:30.662016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-551819d6-e560-4d44-b15e-6a535bbb67d4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:30.662429 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-551819d6-e560-4d44-b15e-6a535bbb67d4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:30.800633 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-551819d6-e560-4d44-b15e-6a535bbb67d4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:30.811925 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-551819d6-e560-4d44-b15e-6a535bbb67d4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:30.813412 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-551819d6-e560-4d44-b15e-6a535bbb67d4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:30.814567 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-551819d6-e560-4d44-b15e-6a535bbb67d4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1724 microversion: 2.20 time: 0.166484 Aug 05 10:34:30.815130 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 492/966] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:30 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:31.841286 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-76a2a0b9-65ab-41d5-8f6e-28b271558f3a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:31.842298 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-76a2a0b9-65ab-41d5-8f6e-28b271558f3a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:31.851413 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-76a2a0b9-65ab-41d5-8f6e-28b271558f3a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:31.851907 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-76a2a0b9-65ab-41d5-8f6e-28b271558f3a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:31.852446 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-76a2a0b9-65ab-41d5-8f6e-28b271558f3a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:31.853092 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-76a2a0b9-65ab-41d5-8f6e-28b271558f3a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:31.853555 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-76a2a0b9-65ab-41d5-8f6e-28b271558f3a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:31.853988 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-76a2a0b9-65ab-41d5-8f6e-28b271558f3a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:31.997302 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-76a2a0b9-65ab-41d5-8f6e-28b271558f3a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:32.006078 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-76a2a0b9-65ab-41d5-8f6e-28b271558f3a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:32.007611 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-76a2a0b9-65ab-41d5-8f6e-28b271558f3a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:32.008862 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-76a2a0b9-65ab-41d5-8f6e-28b271558f3a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1724 microversion: 2.20 time: 0.174218 Aug 05 10:34:32.009500 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 475/967] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:31 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:33.033604 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3f1ff67f-b05b-44e0-ae0a-655bcaa94c7d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:33.034222 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3f1ff67f-b05b-44e0-ae0a-655bcaa94c7d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:33.041338 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3f1ff67f-b05b-44e0-ae0a-655bcaa94c7d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:33.041824 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3f1ff67f-b05b-44e0-ae0a-655bcaa94c7d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:33.042254 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3f1ff67f-b05b-44e0-ae0a-655bcaa94c7d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:33.042941 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3f1ff67f-b05b-44e0-ae0a-655bcaa94c7d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:33.043427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3f1ff67f-b05b-44e0-ae0a-655bcaa94c7d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:33.043848 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3f1ff67f-b05b-44e0-ae0a-655bcaa94c7d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:33.185715 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3f1ff67f-b05b-44e0-ae0a-655bcaa94c7d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:33.194240 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3f1ff67f-b05b-44e0-ae0a-655bcaa94c7d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:33.195793 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3f1ff67f-b05b-44e0-ae0a-655bcaa94c7d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:33.196970 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3f1ff67f-b05b-44e0-ae0a-655bcaa94c7d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1724 microversion: 2.20 time: 0.167486 Aug 05 10:34:33.197481 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 493/968] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:33 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:34.220287 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ad3bf323-0e26-4bfa-bde7-cfb420f4c759 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:34.220927 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-ad3bf323-0e26-4bfa-bde7-cfb420f4c759 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:34.228338 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ad3bf323-0e26-4bfa-bde7-cfb420f4c759 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:34.228821 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ad3bf323-0e26-4bfa-bde7-cfb420f4c759 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:34.229256 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ad3bf323-0e26-4bfa-bde7-cfb420f4c759 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:34.229949 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ad3bf323-0e26-4bfa-bde7-cfb420f4c759 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:34.230400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ad3bf323-0e26-4bfa-bde7-cfb420f4c759 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:34.230825 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ad3bf323-0e26-4bfa-bde7-cfb420f4c759 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:34.379613 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ad3bf323-0e26-4bfa-bde7-cfb420f4c759 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:34.387992 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ad3bf323-0e26-4bfa-bde7-cfb420f4c759 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:34.389483 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ad3bf323-0e26-4bfa-bde7-cfb420f4c759 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:34.390641 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ad3bf323-0e26-4bfa-bde7-cfb420f4c759 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1724 microversion: 2.20 time: 0.174417 Aug 05 10:34:34.391218 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 476/969] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:34 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:35.418840 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4241b80a-d056-4416-a7b6-b03a6cf9196b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:35.419772 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4241b80a-d056-4416-a7b6-b03a6cf9196b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:35.431183 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4241b80a-d056-4416-a7b6-b03a6cf9196b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:35.431946 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4241b80a-d056-4416-a7b6-b03a6cf9196b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:35.432661 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4241b80a-d056-4416-a7b6-b03a6cf9196b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:35.433793 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4241b80a-d056-4416-a7b6-b03a6cf9196b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:35.434542 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4241b80a-d056-4416-a7b6-b03a6cf9196b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:35.435294 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4241b80a-d056-4416-a7b6-b03a6cf9196b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:35.575020 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4241b80a-d056-4416-a7b6-b03a6cf9196b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:35.583403 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4241b80a-d056-4416-a7b6-b03a6cf9196b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:35.584865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4241b80a-d056-4416-a7b6-b03a6cf9196b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:35.586037 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4241b80a-d056-4416-a7b6-b03a6cf9196b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1724 microversion: 2.20 time: 0.173816 Aug 05 10:34:35.586802 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 494/970] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:35 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:36.612906 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-266f09ca-03f1-48e0-aa1e-fb338cd65b65 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:36.613537 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-266f09ca-03f1-48e0-aa1e-fb338cd65b65 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:36.621356 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-266f09ca-03f1-48e0-aa1e-fb338cd65b65 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:36.621874 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-266f09ca-03f1-48e0-aa1e-fb338cd65b65 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:36.622311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-266f09ca-03f1-48e0-aa1e-fb338cd65b65 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:36.623134 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-266f09ca-03f1-48e0-aa1e-fb338cd65b65 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:36.623587 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-266f09ca-03f1-48e0-aa1e-fb338cd65b65 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:36.624009 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-266f09ca-03f1-48e0-aa1e-fb338cd65b65 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:36.763953 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-266f09ca-03f1-48e0-aa1e-fb338cd65b65 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:36.772823 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-266f09ca-03f1-48e0-aa1e-fb338cd65b65 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:36.774302 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-266f09ca-03f1-48e0-aa1e-fb338cd65b65 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:36.775885 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-266f09ca-03f1-48e0-aa1e-fb338cd65b65 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1724 microversion: 2.20 time: 0.168916 Aug 05 10:34:36.776585 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 477/971] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:36 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:37.805947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1b2cfb2f-6335-4eab-a4a7-c0f13afe1ef0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:37.806698 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1b2cfb2f-6335-4eab-a4a7-c0f13afe1ef0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:37.813498 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b2cfb2f-6335-4eab-a4a7-c0f13afe1ef0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:37.813998 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b2cfb2f-6335-4eab-a4a7-c0f13afe1ef0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:37.814431 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b2cfb2f-6335-4eab-a4a7-c0f13afe1ef0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:37.815165 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b2cfb2f-6335-4eab-a4a7-c0f13afe1ef0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:37.815619 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b2cfb2f-6335-4eab-a4a7-c0f13afe1ef0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:37.816492 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1b2cfb2f-6335-4eab-a4a7-c0f13afe1ef0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:37.948934 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1b2cfb2f-6335-4eab-a4a7-c0f13afe1ef0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:37.958641 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1b2cfb2f-6335-4eab-a4a7-c0f13afe1ef0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:37.960291 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1b2cfb2f-6335-4eab-a4a7-c0f13afe1ef0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:37.961473 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1b2cfb2f-6335-4eab-a4a7-c0f13afe1ef0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1724 microversion: 2.20 time: 0.159495 Aug 05 10:34:37.962213 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 495/972] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:37 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:38.988531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f5344f3d-c57f-4d97-a73e-7317986ac06b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:38.989913 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f5344f3d-c57f-4d97-a73e-7317986ac06b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:38.996868 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f5344f3d-c57f-4d97-a73e-7317986ac06b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:38.997354 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f5344f3d-c57f-4d97-a73e-7317986ac06b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:38.997799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f5344f3d-c57f-4d97-a73e-7317986ac06b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:38.998498 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f5344f3d-c57f-4d97-a73e-7317986ac06b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:38.998954 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f5344f3d-c57f-4d97-a73e-7317986ac06b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:38.999405 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f5344f3d-c57f-4d97-a73e-7317986ac06b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:39.135017 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-f5344f3d-c57f-4d97-a73e-7317986ac06b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:39.143325 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-f5344f3d-c57f-4d97-a73e-7317986ac06b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:39.145557 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-f5344f3d-c57f-4d97-a73e-7317986ac06b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:39.147356 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f5344f3d-c57f-4d97-a73e-7317986ac06b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1724 microversion: 2.20 time: 0.164559 Aug 05 10:34:39.147922 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 478/973] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:38 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:40.170504 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-21a799a4-32bc-4710-a9f8-d6fb0383ce21 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:40.171141 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-21a799a4-32bc-4710-a9f8-d6fb0383ce21 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:40.178230 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21a799a4-32bc-4710-a9f8-d6fb0383ce21 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:40.178700 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21a799a4-32bc-4710-a9f8-d6fb0383ce21 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:40.179165 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21a799a4-32bc-4710-a9f8-d6fb0383ce21 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:40.179850 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21a799a4-32bc-4710-a9f8-d6fb0383ce21 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:40.180302 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21a799a4-32bc-4710-a9f8-d6fb0383ce21 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:40.180727 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21a799a4-32bc-4710-a9f8-d6fb0383ce21 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:40.327027 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-21a799a4-32bc-4710-a9f8-d6fb0383ce21 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:40.335904 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-21a799a4-32bc-4710-a9f8-d6fb0383ce21 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:40.337417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-21a799a4-32bc-4710-a9f8-d6fb0383ce21 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:40.338560 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-21a799a4-32bc-4710-a9f8-d6fb0383ce21 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1745 microversion: 2.20 time: 0.171996 Aug 05 10:34:40.339154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 496/974] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:40 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:41.364641 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-56893a25-b580-4ee0-81ad-4d4b7275d6c0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:41.365539 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-56893a25-b580-4ee0-81ad-4d4b7275d6c0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:41.375729 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-56893a25-b580-4ee0-81ad-4d4b7275d6c0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:41.376429 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-56893a25-b580-4ee0-81ad-4d4b7275d6c0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:41.376968 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-56893a25-b580-4ee0-81ad-4d4b7275d6c0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:41.377853 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-56893a25-b580-4ee0-81ad-4d4b7275d6c0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:41.378511 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-56893a25-b580-4ee0-81ad-4d4b7275d6c0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:41.379060 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-56893a25-b580-4ee0-81ad-4d4b7275d6c0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:41.519055 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-56893a25-b580-4ee0-81ad-4d4b7275d6c0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:41.529567 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-56893a25-b580-4ee0-81ad-4d4b7275d6c0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:41.531072 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-56893a25-b580-4ee0-81ad-4d4b7275d6c0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:41.532397 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-56893a25-b580-4ee0-81ad-4d4b7275d6c0 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1745 microversion: 2.20 time: 0.173974 Aug 05 10:34:41.532807 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 479/975] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:41 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:42.559914 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fb59cddc-e534-4acb-aeff-8c3cdf0230f2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:42.560897 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fb59cddc-e534-4acb-aeff-8c3cdf0230f2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:42.571954 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb59cddc-e534-4acb-aeff-8c3cdf0230f2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:42.572783 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb59cddc-e534-4acb-aeff-8c3cdf0230f2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:42.573493 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb59cddc-e534-4acb-aeff-8c3cdf0230f2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:42.574887 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb59cddc-e534-4acb-aeff-8c3cdf0230f2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:42.575722 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb59cddc-e534-4acb-aeff-8c3cdf0230f2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:42.576417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fb59cddc-e534-4acb-aeff-8c3cdf0230f2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:42.719627 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fb59cddc-e534-4acb-aeff-8c3cdf0230f2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:42.730883 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fb59cddc-e534-4acb-aeff-8c3cdf0230f2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:42.733326 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fb59cddc-e534-4acb-aeff-8c3cdf0230f2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:42.735254 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fb59cddc-e534-4acb-aeff-8c3cdf0230f2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1745 microversion: 2.20 time: 0.181475 Aug 05 10:34:42.736065 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 497/976] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:42 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1745 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:43.769462 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-9de2771c-7d3e-4e22-9524-29ed0136284b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:43.770952 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-9de2771c-7d3e-4e22-9524-29ed0136284b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:43.781613 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9de2771c-7d3e-4e22-9524-29ed0136284b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:43.782422 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9de2771c-7d3e-4e22-9524-29ed0136284b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:43.783195 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9de2771c-7d3e-4e22-9524-29ed0136284b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:43.784336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9de2771c-7d3e-4e22-9524-29ed0136284b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:43.785132 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9de2771c-7d3e-4e22-9524-29ed0136284b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:43.785835 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9de2771c-7d3e-4e22-9524-29ed0136284b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:43.920594 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-9de2771c-7d3e-4e22-9524-29ed0136284b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:43.929160 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-9de2771c-7d3e-4e22-9524-29ed0136284b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:43.930653 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-9de2771c-7d3e-4e22-9524-29ed0136284b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:43.931849 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-9de2771c-7d3e-4e22-9524-29ed0136284b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1745 microversion: 2.20 time: 0.168888 Aug 05 10:34:43.932444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 480/977] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:43 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:44.959279 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8a834114-d415-457e-bfe8-9481a8d1fcf7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:44.959870 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8a834114-d415-457e-bfe8-9481a8d1fcf7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:44.966859 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a834114-d415-457e-bfe8-9481a8d1fcf7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:44.967380 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a834114-d415-457e-bfe8-9481a8d1fcf7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:44.967807 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a834114-d415-457e-bfe8-9481a8d1fcf7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:44.968500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a834114-d415-457e-bfe8-9481a8d1fcf7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:44.968950 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a834114-d415-457e-bfe8-9481a8d1fcf7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:44.969371 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a834114-d415-457e-bfe8-9481a8d1fcf7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:45.113037 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8a834114-d415-457e-bfe8-9481a8d1fcf7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:45.126615 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8a834114-d415-457e-bfe8-9481a8d1fcf7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:45.129036 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8a834114-d415-457e-bfe8-9481a8d1fcf7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:45.130664 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8a834114-d415-457e-bfe8-9481a8d1fcf7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1745 microversion: 2.20 time: 0.177997 Aug 05 10:34:45.131297 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 498/978] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:44 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:46.154542 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-2446c86d-2e42-48c7-9d6d-60755515d040 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:46.155311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-2446c86d-2e42-48c7-9d6d-60755515d040 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:46.162358 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2446c86d-2e42-48c7-9d6d-60755515d040 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:46.162940 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2446c86d-2e42-48c7-9d6d-60755515d040 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:46.163427 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2446c86d-2e42-48c7-9d6d-60755515d040 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:46.164221 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2446c86d-2e42-48c7-9d6d-60755515d040 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:46.164799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2446c86d-2e42-48c7-9d6d-60755515d040 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:46.165386 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2446c86d-2e42-48c7-9d6d-60755515d040 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:46.246293 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-84559097-12db-42a4-b317-e0a5c26a8a4f req-5154b7e8-fee2-4758-8968-4e19fba37c1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6a3f62-cb68-4fa9-8c79-b99880a9e1ca", "name": "network-vif-plugged", "status": "completed", "tag": "98cf9379-6188-4844-b4f6-4476ddfb8a7d"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:34:46.257870 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-84559097-12db-42a4-b317-e0a5c26a8a4f req-5154b7e8-fee2-4758-8968-4e19fba37c1f service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:46.258983 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-84559097-12db-42a4-b317-e0a5c26a8a4f req-5154b7e8-fee2-4758-8968-4e19fba37c1f service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:46.259421 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-84559097-12db-42a4-b317-e0a5c26a8a4f req-5154b7e8-fee2-4758-8968-4e19fba37c1f service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:46.273388 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-84559097-12db-42a4-b317-e0a5c26a8a4f req-5154b7e8-fee2-4758-8968-4e19fba37c1f service nova] Creating event network-vif-plugged:98cf9379-6188-4844-b4f6-4476ddfb8a7d for instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca on hv-cinder-81558 Aug 05 10:34:46.278818 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-84559097-12db-42a4-b317-e0a5c26a8a4f req-5154b7e8-fee2-4758-8968-4e19fba37c1f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037228 Aug 05 10:34:46.279642 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 499/979] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:34:46.310968 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2446c86d-2e42-48c7-9d6d-60755515d040 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:46.330806 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2446c86d-2e42-48c7-9d6d-60755515d040 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:46.332403 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2446c86d-2e42-48c7-9d6d-60755515d040 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:46.333506 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-2446c86d-2e42-48c7-9d6d-60755515d040 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1745 microversion: 2.20 time: 0.183567 Aug 05 10:34:46.334095 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 481/980] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:46 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1745 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:47.359327 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-47c26720-cede-4fa8-a555-dca60c7f87ac tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:47.359949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-47c26720-cede-4fa8-a555-dca60c7f87ac tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:47.368803 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47c26720-cede-4fa8-a555-dca60c7f87ac tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:47.369515 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47c26720-cede-4fa8-a555-dca60c7f87ac tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:47.370240 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47c26720-cede-4fa8-a555-dca60c7f87ac tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:47.371227 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47c26720-cede-4fa8-a555-dca60c7f87ac tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:47.371896 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47c26720-cede-4fa8-a555-dca60c7f87ac tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:47.372581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47c26720-cede-4fa8-a555-dca60c7f87ac tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:47.515208 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-47c26720-cede-4fa8-a555-dca60c7f87ac tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:47.523853 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-47c26720-cede-4fa8-a555-dca60c7f87ac tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:47.525454 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-47c26720-cede-4fa8-a555-dca60c7f87ac tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:47.526598 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-47c26720-cede-4fa8-a555-dca60c7f87ac tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1745 microversion: 2.20 time: 0.173483 Aug 05 10:34:47.527168 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 500/981] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:47 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:48.554135 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-edcacc2f-76c4-4832-bb34-ea48ff18969b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:48.555778 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-edcacc2f-76c4-4832-bb34-ea48ff18969b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:48.563166 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-edcacc2f-76c4-4832-bb34-ea48ff18969b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:48.563633 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-edcacc2f-76c4-4832-bb34-ea48ff18969b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:48.564067 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-edcacc2f-76c4-4832-bb34-ea48ff18969b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:48.564779 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-edcacc2f-76c4-4832-bb34-ea48ff18969b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:48.565340 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-edcacc2f-76c4-4832-bb34-ea48ff18969b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:48.565761 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-edcacc2f-76c4-4832-bb34-ea48ff18969b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:48.706491 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-edcacc2f-76c4-4832-bb34-ea48ff18969b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:48.715244 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-edcacc2f-76c4-4832-bb34-ea48ff18969b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:48.716742 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-edcacc2f-76c4-4832-bb34-ea48ff18969b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:48.717957 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-edcacc2f-76c4-4832-bb34-ea48ff18969b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1745 microversion: 2.20 time: 0.170516 Aug 05 10:34:48.718589 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 482/982] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:48 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:49.741820 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d435f5a5-94b6-494d-a754-20d8f2ff56c4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:49.742456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d435f5a5-94b6-494d-a754-20d8f2ff56c4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:49.749009 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d435f5a5-94b6-494d-a754-20d8f2ff56c4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:49.749511 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d435f5a5-94b6-494d-a754-20d8f2ff56c4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:49.749940 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d435f5a5-94b6-494d-a754-20d8f2ff56c4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:49.750634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d435f5a5-94b6-494d-a754-20d8f2ff56c4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:49.751110 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d435f5a5-94b6-494d-a754-20d8f2ff56c4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:49.751522 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d435f5a5-94b6-494d-a754-20d8f2ff56c4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:49.885544 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d435f5a5-94b6-494d-a754-20d8f2ff56c4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:49.893924 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d435f5a5-94b6-494d-a754-20d8f2ff56c4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:49.895819 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d435f5a5-94b6-494d-a754-20d8f2ff56c4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:49.896973 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d435f5a5-94b6-494d-a754-20d8f2ff56c4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1745 microversion: 2.20 time: 0.159160 Aug 05 10:34:49.897523 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 501/983] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:49 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:50.920743 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-2e95d7ae-0535-461a-9512-35a9fa7645dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:50.921329 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-2e95d7ae-0535-461a-9512-35a9fa7645dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:50.928040 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2e95d7ae-0535-461a-9512-35a9fa7645dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:50.928480 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2e95d7ae-0535-461a-9512-35a9fa7645dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:50.929104 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2e95d7ae-0535-461a-9512-35a9fa7645dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:50.930016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2e95d7ae-0535-461a-9512-35a9fa7645dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:50.930505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2e95d7ae-0535-461a-9512-35a9fa7645dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:50.931107 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2e95d7ae-0535-461a-9512-35a9fa7645dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:51.113131 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2e95d7ae-0535-461a-9512-35a9fa7645dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:51.126556 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2e95d7ae-0535-461a-9512-35a9fa7645dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:51.129580 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2e95d7ae-0535-461a-9512-35a9fa7645dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:51.131088 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-2e95d7ae-0535-461a-9512-35a9fa7645dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1740 microversion: 2.20 time: 0.215042 Aug 05 10:34:51.131840 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 483/984] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:50 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1740 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:52.155290 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b72f5a9f-3f0e-4f2d-ae45-7e5b78931cf4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:52.157645 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b72f5a9f-3f0e-4f2d-ae45-7e5b78931cf4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:52.167316 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b72f5a9f-3f0e-4f2d-ae45-7e5b78931cf4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:52.168107 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b72f5a9f-3f0e-4f2d-ae45-7e5b78931cf4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:52.168788 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b72f5a9f-3f0e-4f2d-ae45-7e5b78931cf4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:52.169572 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b72f5a9f-3f0e-4f2d-ae45-7e5b78931cf4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:52.170222 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b72f5a9f-3f0e-4f2d-ae45-7e5b78931cf4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:52.170849 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b72f5a9f-3f0e-4f2d-ae45-7e5b78931cf4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:52.338547 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b72f5a9f-3f0e-4f2d-ae45-7e5b78931cf4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:52.349199 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b72f5a9f-3f0e-4f2d-ae45-7e5b78931cf4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:52.350710 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b72f5a9f-3f0e-4f2d-ae45-7e5b78931cf4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:52.352156 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b72f5a9f-3f0e-4f2d-ae45-7e5b78931cf4 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1740 microversion: 2.20 time: 0.200710 Aug 05 10:34:52.353059 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 502/985] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:52 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:53.377795 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-033d4547-2902-4499-90b3-784eb79eb611 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:53.378394 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-033d4547-2902-4499-90b3-784eb79eb611 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:53.385654 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-033d4547-2902-4499-90b3-784eb79eb611 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:53.386113 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-033d4547-2902-4499-90b3-784eb79eb611 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:53.386543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-033d4547-2902-4499-90b3-784eb79eb611 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:53.387267 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-033d4547-2902-4499-90b3-784eb79eb611 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:53.387714 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-033d4547-2902-4499-90b3-784eb79eb611 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:53.388133 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-033d4547-2902-4499-90b3-784eb79eb611 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:53.544128 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-033d4547-2902-4499-90b3-784eb79eb611 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:53.556416 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-033d4547-2902-4499-90b3-784eb79eb611 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:53.558783 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-033d4547-2902-4499-90b3-784eb79eb611 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:53.560201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-033d4547-2902-4499-90b3-784eb79eb611 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1740 microversion: 2.20 time: 0.186295 Aug 05 10:34:53.560915 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 484/986] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:53 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:54.586959 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6227bc00-f4a9-4f00-b55d-84cd35f69e9e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:54.587830 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6227bc00-f4a9-4f00-b55d-84cd35f69e9e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:54.596945 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6227bc00-f4a9-4f00-b55d-84cd35f69e9e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:54.597464 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6227bc00-f4a9-4f00-b55d-84cd35f69e9e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:54.598104 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6227bc00-f4a9-4f00-b55d-84cd35f69e9e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:54.598840 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6227bc00-f4a9-4f00-b55d-84cd35f69e9e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:54.599552 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6227bc00-f4a9-4f00-b55d-84cd35f69e9e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:54.599720 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6227bc00-f4a9-4f00-b55d-84cd35f69e9e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:54.746394 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6227bc00-f4a9-4f00-b55d-84cd35f69e9e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:54.755202 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6227bc00-f4a9-4f00-b55d-84cd35f69e9e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:54.756764 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6227bc00-f4a9-4f00-b55d-84cd35f69e9e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:54.758136 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6227bc00-f4a9-4f00-b55d-84cd35f69e9e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1740 microversion: 2.20 time: 0.176120 Aug 05 10:34:54.759003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 503/987] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:54 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:55.784035 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-02d59f2f-ff0b-44a7-8f7c-61fd091e7509 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:55.784949 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-02d59f2f-ff0b-44a7-8f7c-61fd091e7509 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:55.792670 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02d59f2f-ff0b-44a7-8f7c-61fd091e7509 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:55.793334 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02d59f2f-ff0b-44a7-8f7c-61fd091e7509 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:55.793803 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02d59f2f-ff0b-44a7-8f7c-61fd091e7509 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:55.794548 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02d59f2f-ff0b-44a7-8f7c-61fd091e7509 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:55.795133 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02d59f2f-ff0b-44a7-8f7c-61fd091e7509 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:55.795751 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02d59f2f-ff0b-44a7-8f7c-61fd091e7509 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:55.943897 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-02d59f2f-ff0b-44a7-8f7c-61fd091e7509 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:55.946501 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=82 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:34:55.954702 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-02d59f2f-ff0b-44a7-8f7c-61fd091e7509 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:55.956541 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-02d59f2f-ff0b-44a7-8f7c-61fd091e7509 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:55.957704 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-02d59f2f-ff0b-44a7-8f7c-61fd091e7509 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1740 microversion: 2.20 time: 0.177650 Aug 05 10:34:55.958433 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 485/988] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:55 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:56.984215 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-10efde77-4fce-49a5-b746-b031690b6b25 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:56.984826 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-10efde77-4fce-49a5-b746-b031690b6b25 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:56.986940 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=32 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:34:56.992973 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10efde77-4fce-49a5-b746-b031690b6b25 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:56.993514 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10efde77-4fce-49a5-b746-b031690b6b25 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:56.994233 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10efde77-4fce-49a5-b746-b031690b6b25 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:56.995134 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10efde77-4fce-49a5-b746-b031690b6b25 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:56.995604 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10efde77-4fce-49a5-b746-b031690b6b25 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:56.996220 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-10efde77-4fce-49a5-b746-b031690b6b25 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:57.000005 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=92 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:34:57.151721 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-10efde77-4fce-49a5-b746-b031690b6b25 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:57.163187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-10efde77-4fce-49a5-b746-b031690b6b25 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:57.165056 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-10efde77-4fce-49a5-b746-b031690b6b25 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:57.166881 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-10efde77-4fce-49a5-b746-b031690b6b25 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1740 microversion: 2.20 time: 0.186764 Aug 05 10:34:57.171697 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 504/989] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:56 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:58.192568 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d111bc64-97ef-4de6-a33d-7d18ce617385 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:58.193410 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d111bc64-97ef-4de6-a33d-7d18ce617385 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:58.196694 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=30 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:34:58.204520 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d111bc64-97ef-4de6-a33d-7d18ce617385 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:58.205307 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d111bc64-97ef-4de6-a33d-7d18ce617385 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:58.205771 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d111bc64-97ef-4de6-a33d-7d18ce617385 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:58.206501 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d111bc64-97ef-4de6-a33d-7d18ce617385 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:58.206986 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d111bc64-97ef-4de6-a33d-7d18ce617385 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:58.207425 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d111bc64-97ef-4de6-a33d-7d18ce617385 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:58.373331 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d111bc64-97ef-4de6-a33d-7d18ce617385 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:58.382422 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d111bc64-97ef-4de6-a33d-7d18ce617385 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:58.384075 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d111bc64-97ef-4de6-a33d-7d18ce617385 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:58.385942 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d111bc64-97ef-4de6-a33d-7d18ce617385 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1740 microversion: 2.20 time: 0.199451 Aug 05 10:34:58.386667 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 486/990] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:58 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:34:59.411888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b9c66e73-b389-491a-ac58-eac78e74c190 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:34:59.412663 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b9c66e73-b389-491a-ac58-eac78e74c190 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:34:59.433773 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b9c66e73-b389-491a-ac58-eac78e74c190 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:59.434445 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b9c66e73-b389-491a-ac58-eac78e74c190 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:59.435203 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b9c66e73-b389-491a-ac58-eac78e74c190 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:59.435784 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b9c66e73-b389-491a-ac58-eac78e74c190 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:34:59.437207 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b9c66e73-b389-491a-ac58-eac78e74c190 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:34:59.437692 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b9c66e73-b389-491a-ac58-eac78e74c190 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:34:59.595314 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b9c66e73-b389-491a-ac58-eac78e74c190 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:59.604880 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b9c66e73-b389-491a-ac58-eac78e74c190 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:59.606510 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b9c66e73-b389-491a-ac58-eac78e74c190 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:34:59.607704 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b9c66e73-b389-491a-ac58-eac78e74c190 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1740 microversion: 2.20 time: 0.199888 Aug 05 10:34:59.608255 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 505/991] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:34:59 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:00.630997 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-184e2c6a-c7f7-4e88-af30-ddd04f843433 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:00.632753 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-184e2c6a-c7f7-4e88-af30-ddd04f843433 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:00.641358 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-184e2c6a-c7f7-4e88-af30-ddd04f843433 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:00.642214 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-184e2c6a-c7f7-4e88-af30-ddd04f843433 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:00.643154 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-184e2c6a-c7f7-4e88-af30-ddd04f843433 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:00.644819 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-184e2c6a-c7f7-4e88-af30-ddd04f843433 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:00.645620 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-184e2c6a-c7f7-4e88-af30-ddd04f843433 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:00.646388 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-184e2c6a-c7f7-4e88-af30-ddd04f843433 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:00.798095 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-184e2c6a-c7f7-4e88-af30-ddd04f843433 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:00.806563 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-184e2c6a-c7f7-4e88-af30-ddd04f843433 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:00.808144 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-184e2c6a-c7f7-4e88-af30-ddd04f843433 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:00.809323 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-184e2c6a-c7f7-4e88-af30-ddd04f843433 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1740 microversion: 2.20 time: 0.182708 Aug 05 10:35:00.809891 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 487/992] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:00 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:01.835097 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-94dac6b8-2b67-46f7-92db-72e208b41774 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:01.835717 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-94dac6b8-2b67-46f7-92db-72e208b41774 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:01.842556 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94dac6b8-2b67-46f7-92db-72e208b41774 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:01.843082 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94dac6b8-2b67-46f7-92db-72e208b41774 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:01.843522 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94dac6b8-2b67-46f7-92db-72e208b41774 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:01.844235 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94dac6b8-2b67-46f7-92db-72e208b41774 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:01.844687 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94dac6b8-2b67-46f7-92db-72e208b41774 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:01.845113 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-94dac6b8-2b67-46f7-92db-72e208b41774 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:01.987392 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-94dac6b8-2b67-46f7-92db-72e208b41774 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:01.995589 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-94dac6b8-2b67-46f7-92db-72e208b41774 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:01.997186 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-94dac6b8-2b67-46f7-92db-72e208b41774 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:01.998344 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-94dac6b8-2b67-46f7-92db-72e208b41774 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1740 microversion: 2.20 time: 0.167172 Aug 05 10:35:01.998924 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 506/993] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:01 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:03.025461 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c4a07034-f9f2-40df-9854-0b00146bc6b8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:03.026611 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c4a07034-f9f2-40df-9854-0b00146bc6b8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:03.036335 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c4a07034-f9f2-40df-9854-0b00146bc6b8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:03.037075 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c4a07034-f9f2-40df-9854-0b00146bc6b8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:03.037741 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c4a07034-f9f2-40df-9854-0b00146bc6b8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:03.038796 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c4a07034-f9f2-40df-9854-0b00146bc6b8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:03.039534 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c4a07034-f9f2-40df-9854-0b00146bc6b8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:03.040187 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c4a07034-f9f2-40df-9854-0b00146bc6b8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:03.192449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c4a07034-f9f2-40df-9854-0b00146bc6b8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:03.201320 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c4a07034-f9f2-40df-9854-0b00146bc6b8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:03.202785 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c4a07034-f9f2-40df-9854-0b00146bc6b8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:03.203979 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c4a07034-f9f2-40df-9854-0b00146bc6b8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1740 microversion: 2.20 time: 0.185299 Aug 05 10:35:03.204551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 488/994] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:03 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:04.231637 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bf133d3a-60fc-4427-ba7d-2d03639c8237 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:04.232617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bf133d3a-60fc-4427-ba7d-2d03639c8237 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:04.243671 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bf133d3a-60fc-4427-ba7d-2d03639c8237 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:04.244459 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bf133d3a-60fc-4427-ba7d-2d03639c8237 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:04.245426 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bf133d3a-60fc-4427-ba7d-2d03639c8237 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:04.246158 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bf133d3a-60fc-4427-ba7d-2d03639c8237 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:04.246617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bf133d3a-60fc-4427-ba7d-2d03639c8237 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:04.247065 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bf133d3a-60fc-4427-ba7d-2d03639c8237 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:04.383339 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bf133d3a-60fc-4427-ba7d-2d03639c8237 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:04.395173 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bf133d3a-60fc-4427-ba7d-2d03639c8237 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:04.396654 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bf133d3a-60fc-4427-ba7d-2d03639c8237 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:04.397802 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bf133d3a-60fc-4427-ba7d-2d03639c8237 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1740 microversion: 2.20 time: 0.173000 Aug 05 10:35:04.398356 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 507/995] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:04 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:05.423047 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-307d99ae-70bb-4a1f-a76f-cb8781be29e5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:05.423672 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-307d99ae-70bb-4a1f-a76f-cb8781be29e5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:05.430376 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-307d99ae-70bb-4a1f-a76f-cb8781be29e5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:05.430876 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-307d99ae-70bb-4a1f-a76f-cb8781be29e5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:05.431377 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-307d99ae-70bb-4a1f-a76f-cb8781be29e5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:05.432154 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-307d99ae-70bb-4a1f-a76f-cb8781be29e5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:05.433278 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-307d99ae-70bb-4a1f-a76f-cb8781be29e5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:05.433716 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-307d99ae-70bb-4a1f-a76f-cb8781be29e5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:05.652622 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-307d99ae-70bb-4a1f-a76f-cb8781be29e5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:05.661129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-307d99ae-70bb-4a1f-a76f-cb8781be29e5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:05.662622 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-307d99ae-70bb-4a1f-a76f-cb8781be29e5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:05.663803 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-307d99ae-70bb-4a1f-a76f-cb8781be29e5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1722 microversion: 2.20 time: 0.246051 Aug 05 10:35:05.664345 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 489/996] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:05 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:06.687390 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-69ce4598-2706-4f5f-9f4b-8d4c1ea62a8a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:06.687865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-69ce4598-2706-4f5f-9f4b-8d4c1ea62a8a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:06.695129 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69ce4598-2706-4f5f-9f4b-8d4c1ea62a8a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:06.695633 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69ce4598-2706-4f5f-9f4b-8d4c1ea62a8a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:06.696062 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69ce4598-2706-4f5f-9f4b-8d4c1ea62a8a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:06.696822 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69ce4598-2706-4f5f-9f4b-8d4c1ea62a8a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:06.697223 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69ce4598-2706-4f5f-9f4b-8d4c1ea62a8a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:06.697762 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69ce4598-2706-4f5f-9f4b-8d4c1ea62a8a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:06.832759 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-69ce4598-2706-4f5f-9f4b-8d4c1ea62a8a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:06.841434 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-69ce4598-2706-4f5f-9f4b-8d4c1ea62a8a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:06.842936 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-69ce4598-2706-4f5f-9f4b-8d4c1ea62a8a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:06.844120 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-69ce4598-2706-4f5f-9f4b-8d4c1ea62a8a tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1722 microversion: 2.20 time: 0.161085 Aug 05 10:35:06.844681 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 508/997] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:06 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:07.867542 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-35d29930-1c75-4490-b397-f1d4efab4080 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:07.868321 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-35d29930-1c75-4490-b397-f1d4efab4080 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:07.875190 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-35d29930-1c75-4490-b397-f1d4efab4080 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:07.875670 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-35d29930-1c75-4490-b397-f1d4efab4080 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:07.876072 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-35d29930-1c75-4490-b397-f1d4efab4080 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:07.876971 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-35d29930-1c75-4490-b397-f1d4efab4080 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:07.877430 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-35d29930-1c75-4490-b397-f1d4efab4080 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:07.877894 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-35d29930-1c75-4490-b397-f1d4efab4080 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:08.014736 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-35d29930-1c75-4490-b397-f1d4efab4080 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:08.023788 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-35d29930-1c75-4490-b397-f1d4efab4080 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:08.025301 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-35d29930-1c75-4490-b397-f1d4efab4080 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:08.026733 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-35d29930-1c75-4490-b397-f1d4efab4080 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1725 microversion: 2.20 time: 0.162977 Aug 05 10:35:08.027237 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 490/998] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:07 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 10:35:08.049552 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-db358a8d-33e6-4df2-999c-087a9cf2d3cb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a480fd0-23c1-4097-9861-b3a843419f81"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:35:08.052201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-db358a8d-33e6-4df2-999c-087a9cf2d3cb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:08.059283 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db358a8d-33e6-4df2-999c-087a9cf2d3cb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:08.059780 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db358a8d-33e6-4df2-999c-087a9cf2d3cb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:08.060169 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db358a8d-33e6-4df2-999c-087a9cf2d3cb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:08.060855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db358a8d-33e6-4df2-999c-087a9cf2d3cb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:08.061299 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db358a8d-33e6-4df2-999c-087a9cf2d3cb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:08.061713 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-db358a8d-33e6-4df2-999c-087a9cf2d3cb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:08.336773 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-cd2286f6-692b-4b9c-8f43-eba96a622189 req-255d2185-5c9b-49a2-a391-3ddd81d2e9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6a3f62-cb68-4fa9-8c79-b99880a9e1ca", "name": "network-vif-unplugged", "status": "completed", "tag": "98cf9379-6188-4844-b4f6-4476ddfb8a7d"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:35:08.347669 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-cd2286f6-692b-4b9c-8f43-eba96a622189 req-255d2185-5c9b-49a2-a391-3ddd81d2e9a2 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:08.348229 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-cd2286f6-692b-4b9c-8f43-eba96a622189 req-255d2185-5c9b-49a2-a391-3ddd81d2e9a2 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:08.348674 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-cd2286f6-692b-4b9c-8f43-eba96a622189 req-255d2185-5c9b-49a2-a391-3ddd81d2e9a2 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:08.361585 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.compute.server_external_events [req-cd2286f6-692b-4b9c-8f43-eba96a622189 req-255d2185-5c9b-49a2-a391-3ddd81d2e9a2 service nova] Unable to find a host for instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca. Dropping event network-vif-unplugged {{(pid=117831) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 05 10:35:08.362469 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-cd2286f6-692b-4b9c-8f43-eba96a622189 req-255d2185-5c9b-49a2-a391-3ddd81d2e9a2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029713 Aug 05 10:35:08.363065 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 491/999] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 05 10:35:08.384006 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-db358a8d-33e6-4df2-999c-087a9cf2d3cb tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "POST /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.338853 Aug 05 10:35:08.384739 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 509/1000] 10.222.0.40 () {62 vars in 1364 bytes} [Fri Aug 5 10:35:08 2022] POST /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca/os-volume_attachments => generated 188 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 10:35:08.506512 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-e0c4d09e-00dd-42ee-883c-4e2cc598117c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:08.507037 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-e0c4d09e-00dd-42ee-883c-4e2cc598117c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:08.513411 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e0c4d09e-00dd-42ee-883c-4e2cc598117c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:08.513882 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e0c4d09e-00dd-42ee-883c-4e2cc598117c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:08.514310 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e0c4d09e-00dd-42ee-883c-4e2cc598117c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:08.515029 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e0c4d09e-00dd-42ee-883c-4e2cc598117c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:08.515474 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e0c4d09e-00dd-42ee-883c-4e2cc598117c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:08.515859 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e0c4d09e-00dd-42ee-883c-4e2cc598117c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:08.766841 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-e0c4d09e-00dd-42ee-883c-4e2cc598117c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "DELETE /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca/os-volume_attachments/2a480fd0-23c1-4097-9861-b3a843419f81" status: 202 len: 0 microversion: 2.20 time: 0.264229 Aug 05 10:35:08.767535 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 492/1001] 10.222.0.40 () {60 vars in 1457 bytes} [Fri Aug 5 10:35:08 2022] DELETE /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca/os-volume_attachments/2a480fd0-23c1-4097-9861-b3a843419f81 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:35:08.833173 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bfe433cf-df63-4f2a-b161-e547a11d2f9d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:35:08.834035 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bfe433cf-df63-4f2a-b161-e547a11d2f9d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:08.842834 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfe433cf-df63-4f2a-b161-e547a11d2f9d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:08.843355 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfe433cf-df63-4f2a-b161-e547a11d2f9d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:08.843791 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfe433cf-df63-4f2a-b161-e547a11d2f9d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:08.844490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfe433cf-df63-4f2a-b161-e547a11d2f9d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:08.844946 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfe433cf-df63-4f2a-b161-e547a11d2f9d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:08.845374 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bfe433cf-df63-4f2a-b161-e547a11d2f9d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:08.875409 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bfe433cf-df63-4f2a-b161-e547a11d2f9d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117832) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 10:35:08.947451 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bfe433cf-df63-4f2a-b161-e547a11d2f9d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "POST /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca/action" status: 202 len: 0 microversion: 2.20 time: 0.121184 Aug 05 10:35:08.948184 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 510/1002] 10.222.0.40 () {62 vars in 1319 bytes} [Fri Aug 5 10:35:08 2022] POST /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:35:08.956160 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-cc0efdb3-4783-446f-aba2-0b465123cb1c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:08.956741 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-cc0efdb3-4783-446f-aba2-0b465123cb1c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:08.964055 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cc0efdb3-4783-446f-aba2-0b465123cb1c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:08.964488 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cc0efdb3-4783-446f-aba2-0b465123cb1c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:08.964926 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cc0efdb3-4783-446f-aba2-0b465123cb1c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:08.965623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cc0efdb3-4783-446f-aba2-0b465123cb1c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:08.966071 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cc0efdb3-4783-446f-aba2-0b465123cb1c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:08.966490 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cc0efdb3-4783-446f-aba2-0b465123cb1c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:09.146280 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-cc0efdb3-4783-446f-aba2-0b465123cb1c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:09.163850 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-cc0efdb3-4783-446f-aba2-0b465123cb1c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:09.165666 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-cc0efdb3-4783-446f-aba2-0b465123cb1c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:09.167006 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-cc0efdb3-4783-446f-aba2-0b465123cb1c tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1673 microversion: 2.20 time: 0.214746 Aug 05 10:35:09.168152 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 493/1003] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:08 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1673 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:10.191512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-924454e5-9bfe-4d6f-8d79-193a157baf8b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:10.192083 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-924454e5-9bfe-4d6f-8d79-193a157baf8b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:10.203006 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-924454e5-9bfe-4d6f-8d79-193a157baf8b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:10.203497 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-924454e5-9bfe-4d6f-8d79-193a157baf8b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:10.203931 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-924454e5-9bfe-4d6f-8d79-193a157baf8b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:10.204634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-924454e5-9bfe-4d6f-8d79-193a157baf8b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:10.205082 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-924454e5-9bfe-4d6f-8d79-193a157baf8b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:10.206235 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-924454e5-9bfe-4d6f-8d79-193a157baf8b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:10.350218 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-924454e5-9bfe-4d6f-8d79-193a157baf8b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:10.359871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-924454e5-9bfe-4d6f-8d79-193a157baf8b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:10.361465 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-924454e5-9bfe-4d6f-8d79-193a157baf8b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:10.363010 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-924454e5-9bfe-4d6f-8d79-193a157baf8b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.176569 Aug 05 10:35:10.363572 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 511/1004] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:10 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:11.394265 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-e1a593af-f194-4fac-a296-38c157da3201 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:11.394852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-e1a593af-f194-4fac-a296-38c157da3201 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:11.408491 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e1a593af-f194-4fac-a296-38c157da3201 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:11.409349 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e1a593af-f194-4fac-a296-38c157da3201 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:11.409975 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e1a593af-f194-4fac-a296-38c157da3201 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:11.410932 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e1a593af-f194-4fac-a296-38c157da3201 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:11.411741 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e1a593af-f194-4fac-a296-38c157da3201 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:11.412361 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e1a593af-f194-4fac-a296-38c157da3201 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:11.595046 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e1a593af-f194-4fac-a296-38c157da3201 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:11.603406 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e1a593af-f194-4fac-a296-38c157da3201 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:11.604945 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e1a593af-f194-4fac-a296-38c157da3201 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:11.606116 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-e1a593af-f194-4fac-a296-38c157da3201 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.216885 Aug 05 10:35:11.606709 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 494/1005] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:11 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:12.631074 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-706a323c-560e-450c-9897-269e098cf267 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:12.631787 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-706a323c-560e-450c-9897-269e098cf267 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:12.641083 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-706a323c-560e-450c-9897-269e098cf267 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:12.641570 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-706a323c-560e-450c-9897-269e098cf267 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:12.642178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-706a323c-560e-450c-9897-269e098cf267 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:12.643021 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-706a323c-560e-450c-9897-269e098cf267 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:12.643831 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-706a323c-560e-450c-9897-269e098cf267 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:12.644247 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-706a323c-560e-450c-9897-269e098cf267 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:12.796185 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-706a323c-560e-450c-9897-269e098cf267 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:12.804530 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-706a323c-560e-450c-9897-269e098cf267 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:12.806259 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-706a323c-560e-450c-9897-269e098cf267 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:12.807480 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-706a323c-560e-450c-9897-269e098cf267 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.181745 Aug 05 10:35:12.808077 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 512/1006] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:12 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:13.830786 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-32b89434-efbc-49ba-93c9-f3f9c5159688 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:13.831378 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-32b89434-efbc-49ba-93c9-f3f9c5159688 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:13.837977 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-32b89434-efbc-49ba-93c9-f3f9c5159688 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:13.838463 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-32b89434-efbc-49ba-93c9-f3f9c5159688 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:13.838923 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-32b89434-efbc-49ba-93c9-f3f9c5159688 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:13.839712 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-32b89434-efbc-49ba-93c9-f3f9c5159688 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:13.841012 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-32b89434-efbc-49ba-93c9-f3f9c5159688 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:13.841451 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-32b89434-efbc-49ba-93c9-f3f9c5159688 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:13.982431 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-32b89434-efbc-49ba-93c9-f3f9c5159688 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:13.992065 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-32b89434-efbc-49ba-93c9-f3f9c5159688 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:13.994131 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-32b89434-efbc-49ba-93c9-f3f9c5159688 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:13.995529 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-32b89434-efbc-49ba-93c9-f3f9c5159688 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.168921 Aug 05 10:35:13.996464 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 495/1007] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:13 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:15.018729 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-642f5020-7b75-4db2-8d61-839aad2315f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:15.019677 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-642f5020-7b75-4db2-8d61-839aad2315f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:15.026307 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-642f5020-7b75-4db2-8d61-839aad2315f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:15.026852 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-642f5020-7b75-4db2-8d61-839aad2315f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:15.027517 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-642f5020-7b75-4db2-8d61-839aad2315f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:15.028182 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-642f5020-7b75-4db2-8d61-839aad2315f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:15.028633 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-642f5020-7b75-4db2-8d61-839aad2315f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:15.029022 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-642f5020-7b75-4db2-8d61-839aad2315f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:15.177128 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-642f5020-7b75-4db2-8d61-839aad2315f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:15.187286 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-642f5020-7b75-4db2-8d61-839aad2315f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:15.188820 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-642f5020-7b75-4db2-8d61-839aad2315f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:15.189979 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-642f5020-7b75-4db2-8d61-839aad2315f5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.176095 Aug 05 10:35:15.190737 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 513/1008] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:15 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:16.217639 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c765eeec-4c40-4a71-9ffc-ce560885de9f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:16.218846 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c765eeec-4c40-4a71-9ffc-ce560885de9f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:16.227227 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c765eeec-4c40-4a71-9ffc-ce560885de9f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:16.227882 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c765eeec-4c40-4a71-9ffc-ce560885de9f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:16.228563 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c765eeec-4c40-4a71-9ffc-ce560885de9f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:16.229409 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c765eeec-4c40-4a71-9ffc-ce560885de9f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:16.229935 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c765eeec-4c40-4a71-9ffc-ce560885de9f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:16.230518 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c765eeec-4c40-4a71-9ffc-ce560885de9f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:16.384701 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c765eeec-4c40-4a71-9ffc-ce560885de9f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:16.393035 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c765eeec-4c40-4a71-9ffc-ce560885de9f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:16.394893 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c765eeec-4c40-4a71-9ffc-ce560885de9f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:16.396091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c765eeec-4c40-4a71-9ffc-ce560885de9f tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.185292 Aug 05 10:35:16.396852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 496/1009] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:16 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:17.420575 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-34096dff-3a85-4685-9a9f-f649389314da tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:17.421278 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-34096dff-3a85-4685-9a9f-f649389314da tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:17.428314 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34096dff-3a85-4685-9a9f-f649389314da tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:17.428813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34096dff-3a85-4685-9a9f-f649389314da tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:17.429258 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34096dff-3a85-4685-9a9f-f649389314da tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:17.429963 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34096dff-3a85-4685-9a9f-f649389314da tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:17.430420 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34096dff-3a85-4685-9a9f-f649389314da tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:17.430860 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-34096dff-3a85-4685-9a9f-f649389314da tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:17.577377 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-34096dff-3a85-4685-9a9f-f649389314da tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:17.586334 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-34096dff-3a85-4685-9a9f-f649389314da tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:17.587854 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-34096dff-3a85-4685-9a9f-f649389314da tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:17.589013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-34096dff-3a85-4685-9a9f-f649389314da tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.173308 Aug 05 10:35:17.589564 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 514/1010] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:17 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:18.616363 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-153aa548-ed2e-4c5f-b5df-36f61e270490 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:18.617709 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-153aa548-ed2e-4c5f-b5df-36f61e270490 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:18.629520 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-153aa548-ed2e-4c5f-b5df-36f61e270490 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:18.630074 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-153aa548-ed2e-4c5f-b5df-36f61e270490 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:18.630507 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-153aa548-ed2e-4c5f-b5df-36f61e270490 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:18.631217 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-153aa548-ed2e-4c5f-b5df-36f61e270490 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:18.631666 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-153aa548-ed2e-4c5f-b5df-36f61e270490 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:18.632086 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-153aa548-ed2e-4c5f-b5df-36f61e270490 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:18.775952 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-153aa548-ed2e-4c5f-b5df-36f61e270490 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:18.785487 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-153aa548-ed2e-4c5f-b5df-36f61e270490 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:18.787134 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-153aa548-ed2e-4c5f-b5df-36f61e270490 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:18.788304 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-153aa548-ed2e-4c5f-b5df-36f61e270490 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.178139 Aug 05 10:35:18.788889 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 497/1011] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:18 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:19.811701 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0d1dd078-48fd-4fbe-95a5-8a1c4a7d7e73 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:19.812441 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0d1dd078-48fd-4fbe-95a5-8a1c4a7d7e73 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:19.819587 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d1dd078-48fd-4fbe-95a5-8a1c4a7d7e73 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:19.820063 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d1dd078-48fd-4fbe-95a5-8a1c4a7d7e73 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:19.820488 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d1dd078-48fd-4fbe-95a5-8a1c4a7d7e73 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:19.821203 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d1dd078-48fd-4fbe-95a5-8a1c4a7d7e73 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:19.821647 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d1dd078-48fd-4fbe-95a5-8a1c4a7d7e73 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:19.822070 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d1dd078-48fd-4fbe-95a5-8a1c4a7d7e73 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:19.965259 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0d1dd078-48fd-4fbe-95a5-8a1c4a7d7e73 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:19.973597 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0d1dd078-48fd-4fbe-95a5-8a1c4a7d7e73 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:19.975101 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0d1dd078-48fd-4fbe-95a5-8a1c4a7d7e73 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:19.976243 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0d1dd078-48fd-4fbe-95a5-8a1c4a7d7e73 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.168638 Aug 05 10:35:19.976776 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 515/1012] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:19 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:21.000611 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-2662648d-48c9-44f8-a8d1-7d5939157580 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:21.001933 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-2662648d-48c9-44f8-a8d1-7d5939157580 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:21.008740 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2662648d-48c9-44f8-a8d1-7d5939157580 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:21.009231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2662648d-48c9-44f8-a8d1-7d5939157580 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:21.010346 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2662648d-48c9-44f8-a8d1-7d5939157580 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:21.011302 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2662648d-48c9-44f8-a8d1-7d5939157580 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:21.011937 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2662648d-48c9-44f8-a8d1-7d5939157580 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:21.012367 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2662648d-48c9-44f8-a8d1-7d5939157580 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:21.156677 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2662648d-48c9-44f8-a8d1-7d5939157580 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:21.166677 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2662648d-48c9-44f8-a8d1-7d5939157580 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:21.168235 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2662648d-48c9-44f8-a8d1-7d5939157580 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:21.169420 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-2662648d-48c9-44f8-a8d1-7d5939157580 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.172894 Aug 05 10:35:21.170005 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 498/1013] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:20 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:21.574625 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7d7bd617-7583-4f22-a8d1-b2902f9709fe tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:21.575370 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7d7bd617-7583-4f22-a8d1-b2902f9709fe tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:21.582402 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d7bd617-7583-4f22-a8d1-b2902f9709fe tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:21.582925 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d7bd617-7583-4f22-a8d1-b2902f9709fe tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:21.583359 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d7bd617-7583-4f22-a8d1-b2902f9709fe tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:21.584057 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d7bd617-7583-4f22-a8d1-b2902f9709fe tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:21.584503 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d7bd617-7583-4f22-a8d1-b2902f9709fe tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:21.584927 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d7bd617-7583-4f22-a8d1-b2902f9709fe tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:21.611866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7d7bd617-7583-4f22-a8d1-b2902f9709fe tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/ips" status: 200 len: 145 microversion: 2.1 time: 0.041116 Aug 05 10:35:21.612440 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 516/1014] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 5 10:35:21 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:35:22.192280 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ad052081-2519-4b8c-b66c-b133264a0a66 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:22.192895 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-ad052081-2519-4b8c-b66c-b133264a0a66 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:22.199824 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ad052081-2519-4b8c-b66c-b133264a0a66 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:22.200304 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ad052081-2519-4b8c-b66c-b133264a0a66 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:22.200735 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ad052081-2519-4b8c-b66c-b133264a0a66 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:22.201438 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ad052081-2519-4b8c-b66c-b133264a0a66 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:22.201889 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ad052081-2519-4b8c-b66c-b133264a0a66 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:22.202313 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ad052081-2519-4b8c-b66c-b133264a0a66 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:22.339863 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ad052081-2519-4b8c-b66c-b133264a0a66 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:22.348378 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ad052081-2519-4b8c-b66c-b133264a0a66 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:22.349876 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ad052081-2519-4b8c-b66c-b133264a0a66 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:22.351057 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ad052081-2519-4b8c-b66c-b133264a0a66 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.162971 Aug 05 10:35:22.351593 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 499/1015] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:22 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:23.378290 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-baccfebc-710f-4ac2-9b34-3e20b6717b93 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:23.379418 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-baccfebc-710f-4ac2-9b34-3e20b6717b93 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:23.386234 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-baccfebc-710f-4ac2-9b34-3e20b6717b93 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:23.386711 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-baccfebc-710f-4ac2-9b34-3e20b6717b93 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:23.387174 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-baccfebc-710f-4ac2-9b34-3e20b6717b93 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:23.387880 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-baccfebc-710f-4ac2-9b34-3e20b6717b93 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:23.388302 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-baccfebc-710f-4ac2-9b34-3e20b6717b93 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:23.388713 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-baccfebc-710f-4ac2-9b34-3e20b6717b93 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:23.404126 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:35:23.524851 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-baccfebc-710f-4ac2-9b34-3e20b6717b93 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:23.535607 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-baccfebc-710f-4ac2-9b34-3e20b6717b93 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:23.537229 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-baccfebc-710f-4ac2-9b34-3e20b6717b93 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:23.538377 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-baccfebc-710f-4ac2-9b34-3e20b6717b93 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.166794 Aug 05 10:35:23.538947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 517/1016] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:23 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:24.038518 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-44c203c7-2656-49d4-9803-1a1c4eede8a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8b28bbf-64ee-43a0-8f47-642d7669eba2"}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:35:24.041043 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-44c203c7-2656-49d4-9803-1a1c4eede8a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:24.047833 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-44c203c7-2656-49d4-9803-1a1c4eede8a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:24.048321 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-44c203c7-2656-49d4-9803-1a1c4eede8a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:24.048730 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-44c203c7-2656-49d4-9803-1a1c4eede8a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:24.049485 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-44c203c7-2656-49d4-9803-1a1c4eede8a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:24.049942 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-44c203c7-2656-49d4-9803-1a1c4eede8a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:24.050367 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-44c203c7-2656-49d4-9803-1a1c4eede8a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:24.067438 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:35:24.564979 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-21299a85-92a1-485b-b11c-14ca18cb420b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:24.565909 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-21299a85-92a1-485b-b11c-14ca18cb420b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:24.577036 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21299a85-92a1-485b-b11c-14ca18cb420b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:24.577824 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21299a85-92a1-485b-b11c-14ca18cb420b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:24.578544 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21299a85-92a1-485b-b11c-14ca18cb420b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:24.579748 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21299a85-92a1-485b-b11c-14ca18cb420b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:24.580501 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21299a85-92a1-485b-b11c-14ca18cb420b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:24.581201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21299a85-92a1-485b-b11c-14ca18cb420b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:24.726868 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-21299a85-92a1-485b-b11c-14ca18cb420b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:24.735116 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-21299a85-92a1-485b-b11c-14ca18cb420b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:24.736595 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-21299a85-92a1-485b-b11c-14ca18cb420b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:24.737735 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-21299a85-92a1-485b-b11c-14ca18cb420b tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.179430 Aug 05 10:35:24.738286 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 518/1017] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:24 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:25.775816 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9ebb56b1-3b67-41ce-ade0-f1642e7780be tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:25.776904 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9ebb56b1-3b67-41ce-ade0-f1642e7780be tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:25.786831 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9ebb56b1-3b67-41ce-ade0-f1642e7780be tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:25.787340 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9ebb56b1-3b67-41ce-ade0-f1642e7780be tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:25.787771 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9ebb56b1-3b67-41ce-ade0-f1642e7780be tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:25.788463 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9ebb56b1-3b67-41ce-ade0-f1642e7780be tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:25.788917 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9ebb56b1-3b67-41ce-ade0-f1642e7780be tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:25.789335 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9ebb56b1-3b67-41ce-ade0-f1642e7780be tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:25.930820 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9ebb56b1-3b67-41ce-ade0-f1642e7780be tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:25.943238 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9ebb56b1-3b67-41ce-ade0-f1642e7780be tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:25.945526 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9ebb56b1-3b67-41ce-ade0-f1642e7780be tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:25.947369 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9ebb56b1-3b67-41ce-ade0-f1642e7780be tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.178304 Aug 05 10:35:25.948169 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 519/1018] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:25 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:26.976107 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-17b8f936-12a4-4c67-896d-c5a0f9e0a13d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:26.976952 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-17b8f936-12a4-4c67-896d-c5a0f9e0a13d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:26.985738 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17b8f936-12a4-4c67-896d-c5a0f9e0a13d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:26.986363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17b8f936-12a4-4c67-896d-c5a0f9e0a13d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:26.986956 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17b8f936-12a4-4c67-896d-c5a0f9e0a13d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:26.987866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17b8f936-12a4-4c67-896d-c5a0f9e0a13d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:26.988466 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17b8f936-12a4-4c67-896d-c5a0f9e0a13d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:26.989164 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17b8f936-12a4-4c67-896d-c5a0f9e0a13d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:27.135226 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-17b8f936-12a4-4c67-896d-c5a0f9e0a13d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:27.147081 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-17b8f936-12a4-4c67-896d-c5a0f9e0a13d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:27.149724 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-17b8f936-12a4-4c67-896d-c5a0f9e0a13d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:27.151211 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-17b8f936-12a4-4c67-896d-c5a0f9e0a13d tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.180318 Aug 05 10:35:27.151822 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 520/1019] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:26 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:28.176585 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-51a673b6-c5f8-4bf0-8a3c-a42520140dab tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:28.177291 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-51a673b6-c5f8-4bf0-8a3c-a42520140dab tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:28.179728 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:35:28.185390 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-51a673b6-c5f8-4bf0-8a3c-a42520140dab tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:28.185882 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-51a673b6-c5f8-4bf0-8a3c-a42520140dab tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:28.186311 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-51a673b6-c5f8-4bf0-8a3c-a42520140dab tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:28.187029 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-51a673b6-c5f8-4bf0-8a3c-a42520140dab tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:28.187475 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-51a673b6-c5f8-4bf0-8a3c-a42520140dab tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:28.187888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-51a673b6-c5f8-4bf0-8a3c-a42520140dab tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:28.333806 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-51a673b6-c5f8-4bf0-8a3c-a42520140dab tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:28.343249 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-51a673b6-c5f8-4bf0-8a3c-a42520140dab tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:28.344729 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-51a673b6-c5f8-4bf0-8a3c-a42520140dab tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:28.345885 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-51a673b6-c5f8-4bf0-8a3c-a42520140dab tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.175524 Aug 05 10:35:28.346440 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 521/1020] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:28 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:29.372607 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-97eda649-da3f-42c5-bc70-8b284a4175bf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:29.374268 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-97eda649-da3f-42c5-bc70-8b284a4175bf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:29.383888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-97eda649-da3f-42c5-bc70-8b284a4175bf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:29.384367 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-97eda649-da3f-42c5-bc70-8b284a4175bf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:29.384986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-97eda649-da3f-42c5-bc70-8b284a4175bf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:29.385751 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-97eda649-da3f-42c5-bc70-8b284a4175bf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:29.386197 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-97eda649-da3f-42c5-bc70-8b284a4175bf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:29.386689 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-97eda649-da3f-42c5-bc70-8b284a4175bf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:29.534984 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-97eda649-da3f-42c5-bc70-8b284a4175bf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:29.548009 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-97eda649-da3f-42c5-bc70-8b284a4175bf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:29.549561 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-97eda649-da3f-42c5-bc70-8b284a4175bf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:29.550728 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-97eda649-da3f-42c5-bc70-8b284a4175bf tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.184802 Aug 05 10:35:29.552690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 522/1021] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:29 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:30.577550 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-21bdcd1e-292e-4cfe-9411-fc361e61f3de tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:30.578212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-21bdcd1e-292e-4cfe-9411-fc361e61f3de tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:30.585439 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21bdcd1e-292e-4cfe-9411-fc361e61f3de tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:30.585914 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21bdcd1e-292e-4cfe-9411-fc361e61f3de tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:30.586341 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21bdcd1e-292e-4cfe-9411-fc361e61f3de tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:30.587068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21bdcd1e-292e-4cfe-9411-fc361e61f3de tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:30.587513 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21bdcd1e-292e-4cfe-9411-fc361e61f3de tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:30.587926 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21bdcd1e-292e-4cfe-9411-fc361e61f3de tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:30.739103 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-21bdcd1e-292e-4cfe-9411-fc361e61f3de tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:30.747732 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-21bdcd1e-292e-4cfe-9411-fc361e61f3de tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:30.749255 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-21bdcd1e-292e-4cfe-9411-fc361e61f3de tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:30.750410 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-21bdcd1e-292e-4cfe-9411-fc361e61f3de tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.179308 Aug 05 10:35:30.750961 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 523/1022] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:30 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:31.776439 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-eecf90dc-f5fe-4422-ac8b-4adf7cbe69aa tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:31.777287 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-eecf90dc-f5fe-4422-ac8b-4adf7cbe69aa tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:31.786501 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eecf90dc-f5fe-4422-ac8b-4adf7cbe69aa tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:31.787009 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eecf90dc-f5fe-4422-ac8b-4adf7cbe69aa tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:31.787436 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eecf90dc-f5fe-4422-ac8b-4adf7cbe69aa tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:31.788126 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eecf90dc-f5fe-4422-ac8b-4adf7cbe69aa tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:31.788559 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eecf90dc-f5fe-4422-ac8b-4adf7cbe69aa tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:31.788976 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eecf90dc-f5fe-4422-ac8b-4adf7cbe69aa tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:31.936677 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-eecf90dc-f5fe-4422-ac8b-4adf7cbe69aa tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:31.945174 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-eecf90dc-f5fe-4422-ac8b-4adf7cbe69aa tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:31.946650 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-eecf90dc-f5fe-4422-ac8b-4adf7cbe69aa tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:31.947829 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-eecf90dc-f5fe-4422-ac8b-4adf7cbe69aa tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.177037 Aug 05 10:35:31.948380 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 524/1023] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:31 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:32.978483 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f1c52843-2e83-4bd9-9916-07f58429276e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:32.979595 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f1c52843-2e83-4bd9-9916-07f58429276e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:32.990006 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1c52843-2e83-4bd9-9916-07f58429276e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:32.990485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1c52843-2e83-4bd9-9916-07f58429276e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:32.990929 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1c52843-2e83-4bd9-9916-07f58429276e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:32.991653 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1c52843-2e83-4bd9-9916-07f58429276e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:32.992105 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1c52843-2e83-4bd9-9916-07f58429276e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:32.992551 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1c52843-2e83-4bd9-9916-07f58429276e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:33.133571 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f1c52843-2e83-4bd9-9916-07f58429276e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:33.141681 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f1c52843-2e83-4bd9-9916-07f58429276e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:33.143564 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f1c52843-2e83-4bd9-9916-07f58429276e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:33.144698 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f1c52843-2e83-4bd9-9916-07f58429276e tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.173381 Aug 05 10:35:33.145285 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 525/1024] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:32 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:34.045997 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=29 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:35:34.131653 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=2 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:35:34.167622 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9ccf1548-8f40-4172-b010-df2fb022e1e3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:34.168246 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9ccf1548-8f40-4172-b010-df2fb022e1e3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:34.175278 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9ccf1548-8f40-4172-b010-df2fb022e1e3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:34.175755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9ccf1548-8f40-4172-b010-df2fb022e1e3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:34.176283 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9ccf1548-8f40-4172-b010-df2fb022e1e3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:34.176991 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9ccf1548-8f40-4172-b010-df2fb022e1e3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:34.177438 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9ccf1548-8f40-4172-b010-df2fb022e1e3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:34.177856 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9ccf1548-8f40-4172-b010-df2fb022e1e3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:34.330288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9ccf1548-8f40-4172-b010-df2fb022e1e3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:34.338701 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9ccf1548-8f40-4172-b010-df2fb022e1e3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:34.340216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9ccf1548-8f40-4172-b010-df2fb022e1e3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:34.342211 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9ccf1548-8f40-4172-b010-df2fb022e1e3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.178354 Aug 05 10:35:34.342737 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 526/1025] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:34 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:34.496324 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-44c203c7-2656-49d4-9803-1a1c4eede8a8 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "POST /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.461803 Aug 05 10:35:34.497086 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 500/1026] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 10:35:24 2022] POST /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/os-volume_attachments => generated 194 bytes in 10463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:35:35.365947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6b34faf5-6d76-440b-8d2b-b6becc20fcd9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:35.366557 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6b34faf5-6d76-440b-8d2b-b6becc20fcd9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:35.373055 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b34faf5-6d76-440b-8d2b-b6becc20fcd9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:35.373532 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b34faf5-6d76-440b-8d2b-b6becc20fcd9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:35.373963 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b34faf5-6d76-440b-8d2b-b6becc20fcd9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:35.374649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b34faf5-6d76-440b-8d2b-b6becc20fcd9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:35.375128 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b34faf5-6d76-440b-8d2b-b6becc20fcd9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:35.375542 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6b34faf5-6d76-440b-8d2b-b6becc20fcd9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:35.521222 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6b34faf5-6d76-440b-8d2b-b6becc20fcd9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:35.529407 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6b34faf5-6d76-440b-8d2b-b6becc20fcd9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:35.530922 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6b34faf5-6d76-440b-8d2b-b6becc20fcd9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:35.532069 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6b34faf5-6d76-440b-8d2b-b6becc20fcd9 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.170427 Aug 05 10:35:35.532619 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 527/1027] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:35 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:36.556319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-11dde109-8e80-403a-bfcd-292ec567c730 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:36.557104 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-11dde109-8e80-403a-bfcd-292ec567c730 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:36.563620 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-11dde109-8e80-403a-bfcd-292ec567c730 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:36.564104 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-11dde109-8e80-403a-bfcd-292ec567c730 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:36.564539 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-11dde109-8e80-403a-bfcd-292ec567c730 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:36.565268 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-11dde109-8e80-403a-bfcd-292ec567c730 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:36.565722 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-11dde109-8e80-403a-bfcd-292ec567c730 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:36.566147 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-11dde109-8e80-403a-bfcd-292ec567c730 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:36.618685 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-6473d31c-9a73-4029-b7ce-d037ca648104 req-a7e81e64-ae9d-4dd9-81e4-a9c572a79654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6a3f62-cb68-4fa9-8c79-b99880a9e1ca", "name": "network-vif-plugged", "status": "completed", "tag": "98cf9379-6188-4844-b4f6-4476ddfb8a7d"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:35:36.629623 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-6473d31c-9a73-4029-b7ce-d037ca648104 req-a7e81e64-ae9d-4dd9-81e4-a9c572a79654 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:36.630185 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-6473d31c-9a73-4029-b7ce-d037ca648104 req-a7e81e64-ae9d-4dd9-81e4-a9c572a79654 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:36.630620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-6473d31c-9a73-4029-b7ce-d037ca648104 req-a7e81e64-ae9d-4dd9-81e4-a9c572a79654 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:36.643783 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-6473d31c-9a73-4029-b7ce-d037ca648104 req-a7e81e64-ae9d-4dd9-81e4-a9c572a79654 service nova] Creating event network-vif-plugged:98cf9379-6188-4844-b4f6-4476ddfb8a7d for instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca on hv-cinder-81558 Aug 05 10:35:36.649486 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-6473d31c-9a73-4029-b7ce-d037ca648104 req-a7e81e64-ae9d-4dd9-81e4-a9c572a79654 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034845 Aug 05 10:35:36.651018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 528/1028] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:35:36.711539 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-11dde109-8e80-403a-bfcd-292ec567c730 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:36.720540 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-11dde109-8e80-403a-bfcd-292ec567c730 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:36.722047 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-11dde109-8e80-403a-bfcd-292ec567c730 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:36.723511 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-11dde109-8e80-403a-bfcd-292ec567c730 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.171953 Aug 05 10:35:36.723857 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 501/1029] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:36 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:37.746656 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bade21c4-f4fa-4ce9-b3e2-92043f51d402 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:37.747449 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bade21c4-f4fa-4ce9-b3e2-92043f51d402 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:37.754479 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bade21c4-f4fa-4ce9-b3e2-92043f51d402 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:37.755015 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bade21c4-f4fa-4ce9-b3e2-92043f51d402 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:37.755424 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bade21c4-f4fa-4ce9-b3e2-92043f51d402 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:37.756116 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bade21c4-f4fa-4ce9-b3e2-92043f51d402 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:37.756559 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bade21c4-f4fa-4ce9-b3e2-92043f51d402 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:37.756971 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bade21c4-f4fa-4ce9-b3e2-92043f51d402 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:37.908251 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bade21c4-f4fa-4ce9-b3e2-92043f51d402 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:37.917451 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bade21c4-f4fa-4ce9-b3e2-92043f51d402 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:37.918991 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bade21c4-f4fa-4ce9-b3e2-92043f51d402 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:37.920202 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bade21c4-f4fa-4ce9-b3e2-92043f51d402 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.177791 Aug 05 10:35:37.920793 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 529/1030] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:37 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:38.945897 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-02dd927b-074a-4cb8-8dda-4addc5337fd1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:38.946443 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-02dd927b-074a-4cb8-8dda-4addc5337fd1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:38.953129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02dd927b-074a-4cb8-8dda-4addc5337fd1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:38.953611 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02dd927b-074a-4cb8-8dda-4addc5337fd1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:38.954049 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02dd927b-074a-4cb8-8dda-4addc5337fd1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:38.954736 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02dd927b-074a-4cb8-8dda-4addc5337fd1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:38.955207 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02dd927b-074a-4cb8-8dda-4addc5337fd1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:38.955625 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-02dd927b-074a-4cb8-8dda-4addc5337fd1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:39.104094 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-02dd927b-074a-4cb8-8dda-4addc5337fd1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:39.112593 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-02dd927b-074a-4cb8-8dda-4addc5337fd1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:39.114327 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-02dd927b-074a-4cb8-8dda-4addc5337fd1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:39.115624 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-02dd927b-074a-4cb8-8dda-4addc5337fd1 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.174035 Aug 05 10:35:39.116222 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 502/1031] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:38 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:39.306804 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7d5a106c-9976-40e5-85ce-e0ac01a9c4ed tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:39.307316 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7d5a106c-9976-40e5-85ce-e0ac01a9c4ed tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:39.308200 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-172db48c-d8db-4e15-95d1-d2c5c32e96f1 req-a47a2e9c-bee8-43c7-a466-f325fce8f43c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b987816b-37ef-46a2-b94e-5c3954662b58", "tag": "b38f7bd7-6d1e-4b76-8780-abac7a1bd11a"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:35:39.313686 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d5a106c-9976-40e5-85ce-e0ac01a9c4ed tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:39.314840 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d5a106c-9976-40e5-85ce-e0ac01a9c4ed tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:39.315493 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d5a106c-9976-40e5-85ce-e0ac01a9c4ed tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:39.316575 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d5a106c-9976-40e5-85ce-e0ac01a9c4ed tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:39.317321 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d5a106c-9976-40e5-85ce-e0ac01a9c4ed tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:39.317909 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7d5a106c-9976-40e5-85ce-e0ac01a9c4ed tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:39.318760 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-172db48c-d8db-4e15-95d1-d2c5c32e96f1 req-a47a2e9c-bee8-43c7-a466-f325fce8f43c service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:39.319288 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-172db48c-d8db-4e15-95d1-d2c5c32e96f1 req-a47a2e9c-bee8-43c7-a466-f325fce8f43c service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:39.319726 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-172db48c-d8db-4e15-95d1-d2c5c32e96f1 req-a47a2e9c-bee8-43c7-a466-f325fce8f43c service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:39.332555 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-172db48c-d8db-4e15-95d1-d2c5c32e96f1 req-a47a2e9c-bee8-43c7-a466-f325fce8f43c service nova] Creating event network-changed:b38f7bd7-6d1e-4b76-8780-abac7a1bd11a for instance b987816b-37ef-46a2-b94e-5c3954662b58 on hv-cinder-81558 Aug 05 10:35:39.337729 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-172db48c-d8db-4e15-95d1-d2c5c32e96f1 req-a47a2e9c-bee8-43c7-a466-f325fce8f43c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033098 Aug 05 10:35:39.341994 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 503/1032] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:35:39.351062 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7d5a106c-9976-40e5-85ce-e0ac01a9c4ed tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 10:35:39.466428 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7d5a106c-9976-40e5-85ce-e0ac01a9c4ed tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 204 len: 0 microversion: 2.1 time: 0.164413 Aug 05 10:35:39.467212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 530/1033] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:35:39 2022] DELETE /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:35:39.478102 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-1141db16-891f-47d2-b199-b3881a8a6109 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:39.479139 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-1141db16-891f-47d2-b199-b3881a8a6109 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:39.487246 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1141db16-891f-47d2-b199-b3881a8a6109 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:39.487737 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1141db16-891f-47d2-b199-b3881a8a6109 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:39.488405 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1141db16-891f-47d2-b199-b3881a8a6109 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:39.490432 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1141db16-891f-47d2-b199-b3881a8a6109 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:39.491134 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1141db16-891f-47d2-b199-b3881a8a6109 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:39.492298 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1141db16-891f-47d2-b199-b3881a8a6109 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:39.679216 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-1141db16-891f-47d2-b199-b3881a8a6109 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:39.687038 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-1141db16-891f-47d2-b199-b3881a8a6109 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1568 microversion: 2.1 time: 0.214848 Aug 05 10:35:39.687678 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 504/1034] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:35:39 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1568 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:35:40.142485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-02f9cdeb-1fcb-4392-bdf3-36f4ccdc11dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:40.143307 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-02f9cdeb-1fcb-4392-bdf3-36f4ccdc11dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:40.149892 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02f9cdeb-1fcb-4392-bdf3-36f4ccdc11dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:40.154650 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02f9cdeb-1fcb-4392-bdf3-36f4ccdc11dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:40.154650 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02f9cdeb-1fcb-4392-bdf3-36f4ccdc11dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:40.154650 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02f9cdeb-1fcb-4392-bdf3-36f4ccdc11dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:40.154650 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02f9cdeb-1fcb-4392-bdf3-36f4ccdc11dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:40.155118 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-02f9cdeb-1fcb-4392-bdf3-36f4ccdc11dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:40.308449 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-02f9cdeb-1fcb-4392-bdf3-36f4ccdc11dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:40.316527 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-02f9cdeb-1fcb-4392-bdf3-36f4ccdc11dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:40.318269 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-02f9cdeb-1fcb-4392-bdf3-36f4ccdc11dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:40.319526 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-02f9cdeb-1fcb-4392-bdf3-36f4ccdc11dc tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1731 microversion: 2.20 time: 0.183525 Aug 05 10:35:40.320087 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 531/1035] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:40 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:40.714788 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-8bd22422-fea9-453f-9856-4f274691e8d0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:40.716959 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-8bd22422-fea9-453f-9856-4f274691e8d0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:40.726677 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8bd22422-fea9-453f-9856-4f274691e8d0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:40.727247 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8bd22422-fea9-453f-9856-4f274691e8d0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:40.727686 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8bd22422-fea9-453f-9856-4f274691e8d0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:40.728449 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8bd22422-fea9-453f-9856-4f274691e8d0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:40.728902 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8bd22422-fea9-453f-9856-4f274691e8d0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:40.729423 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8bd22422-fea9-453f-9856-4f274691e8d0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:40.866608 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-8bd22422-fea9-453f-9856-4f274691e8d0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:40.875012 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-8bd22422-fea9-453f-9856-4f274691e8d0 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1568 microversion: 2.1 time: 0.169002 Aug 05 10:35:40.875583 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 505/1036] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:35:40 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:35:41.344141 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3b51967a-fc21-4f53-841c-501f8ec6c9ed tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:41.344913 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3b51967a-fc21-4f53-841c-501f8ec6c9ed tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:41.353483 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b51967a-fc21-4f53-841c-501f8ec6c9ed tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:41.353969 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b51967a-fc21-4f53-841c-501f8ec6c9ed tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:41.354464 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b51967a-fc21-4f53-841c-501f8ec6c9ed tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:41.355274 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b51967a-fc21-4f53-841c-501f8ec6c9ed tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:41.355728 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b51967a-fc21-4f53-841c-501f8ec6c9ed tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:41.356152 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b51967a-fc21-4f53-841c-501f8ec6c9ed tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:41.568128 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3b51967a-fc21-4f53-841c-501f8ec6c9ed tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:41.576324 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3b51967a-fc21-4f53-841c-501f8ec6c9ed tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:41.577817 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3b51967a-fc21-4f53-841c-501f8ec6c9ed tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:41.579004 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3b51967a-fc21-4f53-841c-501f8ec6c9ed tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1718 microversion: 2.20 time: 0.239260 Aug 05 10:35:41.579559 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 532/1037] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:35:41 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1718 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:35:41.898501 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-7eabd3cc-be39-4909-bdf2-67b1505fcc0d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:41.899165 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-7eabd3cc-be39-4909-bdf2-67b1505fcc0d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:41.906042 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7eabd3cc-be39-4909-bdf2-67b1505fcc0d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:41.906532 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7eabd3cc-be39-4909-bdf2-67b1505fcc0d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:41.906991 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7eabd3cc-be39-4909-bdf2-67b1505fcc0d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:41.907692 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7eabd3cc-be39-4909-bdf2-67b1505fcc0d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:41.908142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7eabd3cc-be39-4909-bdf2-67b1505fcc0d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:41.908562 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7eabd3cc-be39-4909-bdf2-67b1505fcc0d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:42.052537 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-7eabd3cc-be39-4909-bdf2-67b1505fcc0d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:42.060592 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-7eabd3cc-be39-4909-bdf2-67b1505fcc0d tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1568 microversion: 2.1 time: 0.166159 Aug 05 10:35:42.061157 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 506/1038] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:35:41 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:35:42.846003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-c1109f4b-2bf8-448f-a64d-902ffebc9872 req-cc610f09-460d-44f7-851b-020115bfa985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b987816b-37ef-46a2-b94e-5c3954662b58", "name": "network-vif-deleted", "tag": "b38f7bd7-6d1e-4b76-8780-abac7a1bd11a"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:35:42.856227 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c1109f4b-2bf8-448f-a64d-902ffebc9872 req-cc610f09-460d-44f7-851b-020115bfa985 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:42.856694 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c1109f4b-2bf8-448f-a64d-902ffebc9872 req-cc610f09-460d-44f7-851b-020115bfa985 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:42.857120 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c1109f4b-2bf8-448f-a64d-902ffebc9872 req-cc610f09-460d-44f7-851b-020115bfa985 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:42.859799 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:35:42.870514 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-c1109f4b-2bf8-448f-a64d-902ffebc9872 req-cc610f09-460d-44f7-851b-020115bfa985 service nova] Creating event network-vif-deleted:b38f7bd7-6d1e-4b76-8780-abac7a1bd11a for instance b987816b-37ef-46a2-b94e-5c3954662b58 on hv-cinder-81558 Aug 05 10:35:42.875603 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-c1109f4b-2bf8-448f-a64d-902ffebc9872 req-cc610f09-460d-44f7-851b-020115bfa985 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033302 Aug 05 10:35:42.876179 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 533/1039] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:35:43.083162 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-1a9b9b4c-944f-4a98-b10c-6c18124e718e tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:43.083974 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-1a9b9b4c-944f-4a98-b10c-6c18124e718e tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:43.090989 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1a9b9b4c-944f-4a98-b10c-6c18124e718e tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:43.091473 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1a9b9b4c-944f-4a98-b10c-6c18124e718e tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:43.091902 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1a9b9b4c-944f-4a98-b10c-6c18124e718e tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:43.092623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1a9b9b4c-944f-4a98-b10c-6c18124e718e tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:43.093263 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1a9b9b4c-944f-4a98-b10c-6c18124e718e tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:43.093625 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1a9b9b4c-944f-4a98-b10c-6c18124e718e tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:43.166675 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-efc08179-bc86-48f1-850e-e58b20265886 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:43.168995 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-efc08179-bc86-48f1-850e-e58b20265886 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:43.173966 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-1a9b9b4c-944f-4a98-b10c-6c18124e718e tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b9bf1486c745f0bd204307b942809a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4183067b2b9c429d85238263419ec3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:43.179250 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-efc08179-bc86-48f1-850e-e58b20265886 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:43.179965 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-efc08179-bc86-48f1-850e-e58b20265886 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:43.180565 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-efc08179-bc86-48f1-850e-e58b20265886 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:43.181437 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-efc08179-bc86-48f1-850e-e58b20265886 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:43.182038 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-efc08179-bc86-48f1-850e-e58b20265886 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:43.182608 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-efc08179-bc86-48f1-850e-e58b20265886 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:43.184608 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-1a9b9b4c-944f-4a98-b10c-6c18124e718e tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 200 len: 1218 microversion: 2.1 time: 0.105816 Aug 05 10:35:43.187245 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 507/1040] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:35:43 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:35:43.218085 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-efc08179-bc86-48f1-850e-e58b20265886 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066943 Aug 05 10:35:43.219170 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 534/1041] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 10:35:43 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:35:43.229576 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-94d8103f-24d2-4141-b262-15fbcdd3d810 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:43.230499 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-94d8103f-24d2-4141-b262-15fbcdd3d810 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:43.246693 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-94d8103f-24d2-4141-b262-15fbcdd3d810 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:43.247287 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-94d8103f-24d2-4141-b262-15fbcdd3d810 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:43.247779 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-94d8103f-24d2-4141-b262-15fbcdd3d810 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:43.248690 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-94d8103f-24d2-4141-b262-15fbcdd3d810 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:43.249357 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-94d8103f-24d2-4141-b262-15fbcdd3d810 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:43.249993 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-94d8103f-24d2-4141-b262-15fbcdd3d810 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:43.288350 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-94d8103f-24d2-4141-b262-15fbcdd3d810 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/os-volume_attachments/c8b28bbf-64ee-43a0-8f47-642d7669eba2" status: 200 len: 194 microversion: 2.1 time: 0.062704 Aug 05 10:35:43.288956 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 508/1042] 10.222.0.40 () {58 vars in 1413 bytes} [Fri Aug 5 10:35:43 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/os-volume_attachments/c8b28bbf-64ee-43a0-8f47-642d7669eba2 => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:35:44.205813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d7ab4a7f-f7cc-4476-8707-b56fba60cc2a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:44.206294 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d7ab4a7f-f7cc-4476-8707-b56fba60cc2a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] [instance: b987816b-37ef-46a2-b94e-5c3954662b58] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:44.213430 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d7ab4a7f-f7cc-4476-8707-b56fba60cc2a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:44.213956 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d7ab4a7f-f7cc-4476-8707-b56fba60cc2a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:44.214381 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d7ab4a7f-f7cc-4476-8707-b56fba60cc2a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:44.215107 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d7ab4a7f-f7cc-4476-8707-b56fba60cc2a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:44.215579 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d7ab4a7f-f7cc-4476-8707-b56fba60cc2a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:44.215993 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d7ab4a7f-f7cc-4476-8707-b56fba60cc2a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:44.229824 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-d7ab4a7f-f7cc-4476-8707-b56fba60cc2a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] HTTP exception thrown: Instance b987816b-37ef-46a2-b94e-5c3954662b58 could not be found. Aug 05 10:35:44.231494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d7ab4a7f-f7cc-4476-8707-b56fba60cc2a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Request method failure captured: Aug 05 10:35:44.231494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 HTTP/1.1 Aug 05 10:35:44.231494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:35:44.231494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:35:44.231494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:35:44.231494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:35:44.231494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:35:44.231494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:35:44.231494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:35:44.231494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:35:44.231494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PDvOchh4Aa9CIJt_dY7KU4cHwAvi1ietTD_cJccIe-BPKQn8eQbxcfCTgy4IJrdS3A3ePZcjbzKNO2k8DVz9nhZ23pB5Trw3PaoYySiSmQDParNJu6i8bjYi8Kyrhn8WXK2I8IysC6CnJVw9US8eUQv1HjJDh7_qDdLC2ILIpeNLiI Aug 05 10:35:44.231494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:35:44.231494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:35:44.231494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:35:44.231494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:35:44.231494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:35:44.231494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:35:44.231494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 4183067b2b9c429d85238263419ec3f7 Aug 05 10:35:44.231494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-TestShelveInstance-827527537 Aug 05 10:35:44.231494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:35:44.231494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:35:44.233121 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4183067b2b9c429d85238263419ec3f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4183067b2b9c429d85238263419ec3f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4183067b2b9c429d85238263419ec3f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4183067b2b9c429d85238263419ec3f7"}]}] Aug 05 10:35:44.233121 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-TestShelveInstance-827527537 Aug 05 10:35:44.233121 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 4183067b2b9c429d85238263419ec3f7 Aug 05 10:35:44.233121 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-TestShelveInstance-827527537 Aug 05 10:35:44.233121 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-TestShelveInstance-827527537-project Aug 05 10:35:44.233121 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:35:44.233121 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:35:44.233121 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: a4b9bf1486c745f0bd204307b942809a Aug 05 10:35:44.233121 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-TestShelveInstance-827527537-project Aug 05 10:35:44.233121 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:35:44.233121 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Instance b987816b-37ef-46a2-b94e-5c3954662b58 could not be found. Aug 05 10:35:44.233121 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': 'b987816b-37ef-46a2-b94e-5c3954662b58'} Aug 05 10:35:44.234177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:35:44.234177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:35:44.234177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:35:44.234177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:35:44.234177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:35:44.234177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:35:44.234177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:35:44.234177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:35:44.234177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:35:44.234177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:35:44.234177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b987816b-37ef-46a2-b94e-5c3954662b58 could not be found. Aug 05 10:35:44.234177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:35:44.234177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:35:44.234177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:35:44.234177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:35:44.234177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:35:44.234177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:35:44.234177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:35:44.234177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:35:44.234177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:35:44.235761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:35:44.235761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:35:44.235761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:35:44.235761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:35:44.235761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:35:44.235761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:35:44.235761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:35:44.235761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b987816b-37ef-46a2-b94e-5c3954662b58 could not be found. Aug 05 10:35:44.235761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:35:44.235761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:35:44.235761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:35:44.235761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:35:44.235761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:35:44.235761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:35:44.235761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:35:44.235761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:35:44.235761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b987816b-37ef-46a2-b94e-5c3954662b58 could not be found. Aug 05 10:35:44.235761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:35:44.237233 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d7ab4a7f-f7cc-4476-8707-b56fba60cc2a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Returning 404 to user: Instance b987816b-37ef-46a2-b94e-5c3954662b58 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:35:44.237233 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d7ab4a7f-f7cc-4476-8707-b56fba60cc2a tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58" status: 404 len: 111 microversion: 2.1 time: 0.031082 Aug 05 10:35:44.237233 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 535/1043] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:35:44 2022] GET /compute/v2.1/servers/b987816b-37ef-46a2-b94e-5c3954662b58 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:35:44.421048 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-1dcbebea-774a-40ed-b497-ea7482f0ffb3 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] Calling method '.version_select at 0x7f7327597dc0>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:44.445012 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-1dcbebea-774a-40ed-b497-ea7482f0ffb3 tempest-TestShelveInstance-827527537 tempest-TestShelveInstance-827527537-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-84234557" status: 202 len: 0 microversion: 2.1 time: 0.028178 Aug 05 10:35:44.445631 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 509/1044] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 5 10:35:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-84234557 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:35:44.637958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6d08ba8a-0fcd-48a1-a35e-e70c783545de tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5ae392d-7645-456a-b551-32d98448709f"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:35:44.640337 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6d08ba8a-0fcd-48a1-a35e-e70c783545de tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:44.646780 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d08ba8a-0fcd-48a1-a35e-e70c783545de tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:44.647303 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d08ba8a-0fcd-48a1-a35e-e70c783545de tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:44.647742 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d08ba8a-0fcd-48a1-a35e-e70c783545de tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:44.648473 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d08ba8a-0fcd-48a1-a35e-e70c783545de tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:44.648928 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d08ba8a-0fcd-48a1-a35e-e70c783545de tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:44.649355 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d08ba8a-0fcd-48a1-a35e-e70c783545de tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:44.929772 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6d08ba8a-0fcd-48a1-a35e-e70c783545de tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "POST /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295635 Aug 05 10:35:44.930381 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 536/1045] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 10:35:44 2022] POST /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:35:52.499431 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-6045c58a-7fc7-4496-bce3-577d876e6794 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:52.501569 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-6045c58a-7fc7-4496-bce3-577d876e6794 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:52.509451 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6045c58a-7fc7-4496-bce3-577d876e6794 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:52.509926 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6045c58a-7fc7-4496-bce3-577d876e6794 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:52.510361 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6045c58a-7fc7-4496-bce3-577d876e6794 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:52.511078 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6045c58a-7fc7-4496-bce3-577d876e6794 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:52.511525 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6045c58a-7fc7-4496-bce3-577d876e6794 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:52.511940 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6045c58a-7fc7-4496-bce3-577d876e6794 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:52.550509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-6045c58a-7fc7-4496-bce3-577d876e6794 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055182 Aug 05 10:35:52.551123 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 510/1046] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 10:35:52 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:35:52.695864 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a8bf9b47-374b-49c6-9fca-19b46032aa59 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:52.696437 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a8bf9b47-374b-49c6-9fca-19b46032aa59 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:52.703211 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8bf9b47-374b-49c6-9fca-19b46032aa59 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:52.703717 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8bf9b47-374b-49c6-9fca-19b46032aa59 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:52.704124 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8bf9b47-374b-49c6-9fca-19b46032aa59 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:52.704821 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8bf9b47-374b-49c6-9fca-19b46032aa59 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:52.705277 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8bf9b47-374b-49c6-9fca-19b46032aa59 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:52.705696 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8bf9b47-374b-49c6-9fca-19b46032aa59 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:52.735093 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a8bf9b47-374b-49c6-9fca-19b46032aa59 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/os-volume_attachments/c8b28bbf-64ee-43a0-8f47-642d7669eba2" status: 200 len: 194 microversion: 2.1 time: 0.045001 Aug 05 10:35:52.735662 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 537/1047] 10.222.0.40 () {58 vars in 1413 bytes} [Fri Aug 5 10:35:52 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/os-volume_attachments/c8b28bbf-64ee-43a0-8f47-642d7669eba2 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:35:52.746439 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-140924ef-7f31-4a12-8eb8-83487ff3f186 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:52.746946 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-140924ef-7f31-4a12-8eb8-83487ff3f186 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:52.753111 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-140924ef-7f31-4a12-8eb8-83487ff3f186 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:52.753630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-140924ef-7f31-4a12-8eb8-83487ff3f186 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:52.754069 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-140924ef-7f31-4a12-8eb8-83487ff3f186 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:52.755067 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-140924ef-7f31-4a12-8eb8-83487ff3f186 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:52.755530 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-140924ef-7f31-4a12-8eb8-83487ff3f186 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:52.755962 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-140924ef-7f31-4a12-8eb8-83487ff3f186 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:52.847262 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.objects.instance [None req-140924ef-7f31-4a12-8eb8-83487ff3f186 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lazy-loading 'services' on Instance uuid 550ef045-da80-4060-96f5-88bfcbba7c2e {{(pid=117831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:35:52.926432 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-140924ef-7f31-4a12-8eb8-83487ff3f186 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "DELETE /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/os-volume_attachments/c8b28bbf-64ee-43a0-8f47-642d7669eba2" status: 202 len: 0 microversion: 2.1 time: 0.183817 Aug 05 10:35:52.927147 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 511/1048] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 5 10:35:52 2022] DELETE /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/os-volume_attachments/c8b28bbf-64ee-43a0-8f47-642d7669eba2 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:35:55.114321 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-21ef14a8-7f6e-4303-8a28-72f89dc0494c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:55.115032 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-21ef14a8-7f6e-4303-8a28-72f89dc0494c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:55.122214 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21ef14a8-7f6e-4303-8a28-72f89dc0494c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:55.122702 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21ef14a8-7f6e-4303-8a28-72f89dc0494c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:55.123179 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21ef14a8-7f6e-4303-8a28-72f89dc0494c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:55.123879 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21ef14a8-7f6e-4303-8a28-72f89dc0494c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:55.124338 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21ef14a8-7f6e-4303-8a28-72f89dc0494c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:55.124763 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21ef14a8-7f6e-4303-8a28-72f89dc0494c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:55.156514 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-21ef14a8-7f6e-4303-8a28-72f89dc0494c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/os-volume_attachments/b5ae392d-7645-456a-b551-32d98448709f" status: 200 len: 194 microversion: 2.1 time: 0.045431 Aug 05 10:35:55.157389 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 538/1049] 10.222.0.40 () {58 vars in 1413 bytes} [Fri Aug 5 10:35:55 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/os-volume_attachments/b5ae392d-7645-456a-b551-32d98448709f => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:35:55.171180 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-2cf89029-ba01-42d4-895e-2dbef7e6a5b7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:55.171800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-2cf89029-ba01-42d4-895e-2dbef7e6a5b7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:55.179470 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2cf89029-ba01-42d4-895e-2dbef7e6a5b7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:55.179947 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2cf89029-ba01-42d4-895e-2dbef7e6a5b7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:55.180375 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2cf89029-ba01-42d4-895e-2dbef7e6a5b7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:55.181061 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2cf89029-ba01-42d4-895e-2dbef7e6a5b7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:55.181503 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2cf89029-ba01-42d4-895e-2dbef7e6a5b7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:55.181921 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2cf89029-ba01-42d4-895e-2dbef7e6a5b7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:55.273210 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.objects.instance [None req-2cf89029-ba01-42d4-895e-2dbef7e6a5b7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lazy-loading 'services' on Instance uuid 550ef045-da80-4060-96f5-88bfcbba7c2e {{(pid=117831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:35:55.353927 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-2cf89029-ba01-42d4-895e-2dbef7e6a5b7 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "DELETE /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/os-volume_attachments/b5ae392d-7645-456a-b551-32d98448709f" status: 202 len: 0 microversion: 2.1 time: 0.190105 Aug 05 10:35:55.354515 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 512/1050] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 5 10:35:55 2022] DELETE /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/os-volume_attachments/b5ae392d-7645-456a-b551-32d98448709f => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:35:56.524780 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2e186d82-c348-4cf6-ac5a-cc6c375b8456 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:56.527079 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2e186d82-c348-4cf6-ac5a-cc6c375b8456 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:56.533642 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e186d82-c348-4cf6-ac5a-cc6c375b8456 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:56.534122 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e186d82-c348-4cf6-ac5a-cc6c375b8456 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:56.534551 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e186d82-c348-4cf6-ac5a-cc6c375b8456 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:56.535288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e186d82-c348-4cf6-ac5a-cc6c375b8456 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:56.535738 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e186d82-c348-4cf6-ac5a-cc6c375b8456 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:56.536162 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e186d82-c348-4cf6-ac5a-cc6c375b8456 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:56.567303 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2e186d82-c348-4cf6-ac5a-cc6c375b8456 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046085 Aug 05 10:35:56.567981 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 539/1051] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 10:35:56 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 05 10:35:56.689519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d1fce04c-8d0a-44fa-938c-3cde6037ae8f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:56.693464 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d1fce04c-8d0a-44fa-938c-3cde6037ae8f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:56.704774 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d1fce04c-8d0a-44fa-938c-3cde6037ae8f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:56.705668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d1fce04c-8d0a-44fa-938c-3cde6037ae8f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:56.706521 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d1fce04c-8d0a-44fa-938c-3cde6037ae8f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:56.708441 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d1fce04c-8d0a-44fa-938c-3cde6037ae8f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:56.709021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d1fce04c-8d0a-44fa-938c-3cde6037ae8f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:56.709493 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d1fce04c-8d0a-44fa-938c-3cde6037ae8f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:56.740245 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d1fce04c-8d0a-44fa-938c-3cde6037ae8f tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058115 Aug 05 10:35:56.740906 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 513/1052] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 10:35:56 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 10:35:56.803295 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a00d100c-1bcc-4b94-9a9d-c9a08d56730c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:56.803794 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a00d100c-1bcc-4b94-9a9d-c9a08d56730c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:56.810324 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a00d100c-1bcc-4b94-9a9d-c9a08d56730c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:56.810810 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a00d100c-1bcc-4b94-9a9d-c9a08d56730c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:56.811248 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a00d100c-1bcc-4b94-9a9d-c9a08d56730c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:56.811944 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a00d100c-1bcc-4b94-9a9d-c9a08d56730c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:56.812400 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a00d100c-1bcc-4b94-9a9d-c9a08d56730c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:56.812828 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a00d100c-1bcc-4b94-9a9d-c9a08d56730c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:56.839522 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a00d100c-1bcc-4b94-9a9d-c9a08d56730c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 10:35:56.930762 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a00d100c-1bcc-4b94-9a9d-c9a08d56730c tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "DELETE /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e" status: 204 len: 0 microversion: 2.1 time: 0.131146 Aug 05 10:35:56.931390 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 540/1053] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:35:56 2022] DELETE /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:35:56.939904 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b375c766-36cf-4edb-bae3-03a00befa72e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:56.940529 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b375c766-36cf-4edb-bae3-03a00befa72e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:56.946829 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b375c766-36cf-4edb-bae3-03a00befa72e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:56.947367 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b375c766-36cf-4edb-bae3-03a00befa72e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:56.947801 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b375c766-36cf-4edb-bae3-03a00befa72e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:56.948470 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b375c766-36cf-4edb-bae3-03a00befa72e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:56.948920 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b375c766-36cf-4edb-bae3-03a00befa72e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:56.949358 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b375c766-36cf-4edb-bae3-03a00befa72e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:57.087851 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b375c766-36cf-4edb-bae3-03a00befa72e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:57.096056 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b375c766-36cf-4edb-bae3-03a00befa72e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e" status: 200 len: 1672 microversion: 2.1 time: 0.160165 Aug 05 10:35:57.096542 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 514/1054] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:35:56 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:35:58.123477 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ac17d8a9-09f0-426c-8074-e53c69cf5c8e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:58.124660 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ac17d8a9-09f0-426c-8074-e53c69cf5c8e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:58.136009 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ac17d8a9-09f0-426c-8074-e53c69cf5c8e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:58.136803 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ac17d8a9-09f0-426c-8074-e53c69cf5c8e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:58.137522 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ac17d8a9-09f0-426c-8074-e53c69cf5c8e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:58.138660 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ac17d8a9-09f0-426c-8074-e53c69cf5c8e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:58.139457 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ac17d8a9-09f0-426c-8074-e53c69cf5c8e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:58.140157 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ac17d8a9-09f0-426c-8074-e53c69cf5c8e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:58.291906 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ac17d8a9-09f0-426c-8074-e53c69cf5c8e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:58.303802 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ac17d8a9-09f0-426c-8074-e53c69cf5c8e tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e" status: 200 len: 1672 microversion: 2.1 time: 0.187464 Aug 05 10:35:58.304369 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 541/1055] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:35:58 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e => generated 1672 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:35:59.328793 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-9beeeaa7-5f23-4090-b229-c88f782f53a2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:35:59.329719 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-9beeeaa7-5f23-4090-b229-c88f782f53a2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:35:59.340647 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9beeeaa7-5f23-4090-b229-c88f782f53a2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:59.341384 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9beeeaa7-5f23-4090-b229-c88f782f53a2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:59.342053 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9beeeaa7-5f23-4090-b229-c88f782f53a2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:59.343311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9beeeaa7-5f23-4090-b229-c88f782f53a2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:35:59.343972 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9beeeaa7-5f23-4090-b229-c88f782f53a2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:35:59.344625 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9beeeaa7-5f23-4090-b229-c88f782f53a2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:35:59.570059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-9beeeaa7-5f23-4090-b229-c88f782f53a2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:35:59.578142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-9beeeaa7-5f23-4090-b229-c88f782f53a2 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e" status: 200 len: 1672 microversion: 2.1 time: 0.255534 Aug 05 10:35:59.578717 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 515/1056] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:35:59 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e => generated 1672 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:36:00.557309 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-6f9bdd22-63e1-4620-85be-4b6171e9a738 req-4ddfed33-ac6e-450d-b85c-594dd58e1462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "550ef045-da80-4060-96f5-88bfcbba7c2e", "name": "network-vif-deleted", "tag": "a268db27-ea21-4b2b-9e93-ef52a61b02d0"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:36:00.563718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:36:00.570797 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-6f9bdd22-63e1-4620-85be-4b6171e9a738 req-4ddfed33-ac6e-450d-b85c-594dd58e1462 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:00.571307 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-6f9bdd22-63e1-4620-85be-4b6171e9a738 req-4ddfed33-ac6e-450d-b85c-594dd58e1462 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:00.571728 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-6f9bdd22-63e1-4620-85be-4b6171e9a738 req-4ddfed33-ac6e-450d-b85c-594dd58e1462 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:00.584123 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-6f9bdd22-63e1-4620-85be-4b6171e9a738 req-4ddfed33-ac6e-450d-b85c-594dd58e1462 service nova] Creating event network-vif-deleted:a268db27-ea21-4b2b-9e93-ef52a61b02d0 for instance 550ef045-da80-4060-96f5-88bfcbba7c2e on hv-cinder-81558 Aug 05 10:36:00.589248 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-6f9bdd22-63e1-4620-85be-4b6171e9a738 req-4ddfed33-ac6e-450d-b85c-594dd58e1462 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035893 Aug 05 10:36:00.592746 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 542/1057] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:36:00.600755 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-e88e57ec-9f6a-4a1e-acaa-4e35b0178f76 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:00.601605 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-e88e57ec-9f6a-4a1e-acaa-4e35b0178f76 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:00.607857 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e88e57ec-9f6a-4a1e-acaa-4e35b0178f76 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:00.608336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e88e57ec-9f6a-4a1e-acaa-4e35b0178f76 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:00.608764 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e88e57ec-9f6a-4a1e-acaa-4e35b0178f76 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:00.609917 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e88e57ec-9f6a-4a1e-acaa-4e35b0178f76 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:00.609917 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e88e57ec-9f6a-4a1e-acaa-4e35b0178f76 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:00.610298 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e88e57ec-9f6a-4a1e-acaa-4e35b0178f76 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:00.629690 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:36:00.679008 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e88e57ec-9f6a-4a1e-acaa-4e35b0178f76 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7eb355fac04252a4be1f8e60037924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40807f4af05048deae68cf3515433261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:36:00.687007 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-e88e57ec-9f6a-4a1e-acaa-4e35b0178f76 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e" status: 200 len: 1321 microversion: 2.1 time: 0.090994 Aug 05 10:36:00.687579 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 516/1058] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:36:00 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e => generated 1321 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:36:01.713722 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2f692f9a-aca9-4fc2-b71a-6a472f94ea5b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:01.714608 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2f692f9a-aca9-4fc2-b71a-6a472f94ea5b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:01.722883 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2f692f9a-aca9-4fc2-b71a-6a472f94ea5b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:01.723516 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2f692f9a-aca9-4fc2-b71a-6a472f94ea5b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:01.724047 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2f692f9a-aca9-4fc2-b71a-6a472f94ea5b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:01.724929 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2f692f9a-aca9-4fc2-b71a-6a472f94ea5b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:01.725557 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2f692f9a-aca9-4fc2-b71a-6a472f94ea5b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:01.725979 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2f692f9a-aca9-4fc2-b71a-6a472f94ea5b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:01.739734 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-2f692f9a-aca9-4fc2-b71a-6a472f94ea5b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] HTTP exception thrown: Instance 550ef045-da80-4060-96f5-88bfcbba7c2e could not be found. Aug 05 10:36:01.741378 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2f692f9a-aca9-4fc2-b71a-6a472f94ea5b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Request method failure captured: Aug 05 10:36:01.741378 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e HTTP/1.1 Aug 05 10:36:01.741378 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:36:01.741378 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:36:01.741378 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:36:01.741378 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:36:01.741378 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:36:01.741378 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:36:01.741378 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:36:01.741378 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:01.741378 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PBVvKEAgXr09AeP8_YyDN_3Qg97MKcRPfZfBv7XPmAMY6XGbdZkao3LWiN6xJSWxQo0C3sWAoUgAiuk9TXnxRXxqF632u9O-sRLYlUKqbNv6LTvL8-V362JLe2HbL5YUpqikP3hRhQT8BF6T22y6WTFPUrTUTtXvezcNTjWvs0YxMM Aug 05 10:36:01.741378 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:36:01.741378 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:36:01.741378 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:36:01.741378 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:36:01.741378 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:36:01.741378 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:36:01.741378 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 40807f4af05048deae68cf3515433261 Aug 05 10:36:01.741378 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeTestJSON-1698462425 Aug 05 10:36:01.741378 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:36:01.741378 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:36:01.743174 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_40807f4af05048deae68cf3515433261"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/40807f4af05048deae68cf3515433261"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40807f4af05048deae68cf3515433261"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40807f4af05048deae68cf3515433261"}]}] Aug 05 10:36:01.743174 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeTestJSON-1698462425 Aug 05 10:36:01.743174 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 40807f4af05048deae68cf3515433261 Aug 05 10:36:01.743174 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1698462425 Aug 05 10:36:01.743174 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeTestJSON-1698462425-project Aug 05 10:36:01.743174 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:36:01.743174 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:36:01.743174 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: 7e7eb355fac04252a4be1f8e60037924 Aug 05 10:36:01.743174 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeTestJSON-1698462425-project Aug 05 10:36:01.743174 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:36:01.743174 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Instance 550ef045-da80-4060-96f5-88bfcbba7c2e could not be found. Aug 05 10:36:01.743174 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': '550ef045-da80-4060-96f5-88bfcbba7c2e'} Aug 05 10:36:01.744068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:01.744068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:01.744068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:36:01.744068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:36:01.744068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:36:01.744068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:36:01.744068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:36:01.744068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:36:01.744068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:36:01.744068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:36:01.744068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 550ef045-da80-4060-96f5-88bfcbba7c2e could not be found. Aug 05 10:36:01.744068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:01.744068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:01.744068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:01.744068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:01.744068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:01.744068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:01.744068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:01.744068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:01.744068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:01.745581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:01.745581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:36:01.745581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:36:01.745581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:36:01.745581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:36:01.745581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:36:01.745581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:01.745581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 550ef045-da80-4060-96f5-88bfcbba7c2e could not be found. Aug 05 10:36:01.745581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:01.745581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:01.745581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:01.745581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:01.745581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:01.745581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:01.745581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:01.745581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:01.745581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 550ef045-da80-4060-96f5-88bfcbba7c2e could not be found. Aug 05 10:36:01.745581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:01.746955 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2f692f9a-aca9-4fc2-b71a-6a472f94ea5b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Returning 404 to user: Instance 550ef045-da80-4060-96f5-88bfcbba7c2e could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:01.746955 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2f692f9a-aca9-4fc2-b71a-6a472f94ea5b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e" status: 404 len: 111 microversion: 2.1 time: 0.036501 Aug 05 10:36:01.746955 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 543/1059] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:36:01 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:36:01.752129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-1720c797-ff31-429e-9b3a-1d3f851fef22 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '.version_select at 0x7f732765bb80>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:01.773230 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-1720c797-ff31-429e-9b3a-1d3f851fef22 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-603017824" status: 202 len: 0 microversion: 2.1 time: 0.024952 Aug 05 10:36:01.774273 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 517/1060] 10.222.0.40 () {58 vars in 1218 bytes} [Fri Aug 5 10:36:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-603017824 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:36:04.699476 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3e8d6882-b42c-4377-8afd-ab2b333635a6 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:04.700139 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3e8d6882-b42c-4377-8afd-ab2b333635a6 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:04.707133 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e8d6882-b42c-4377-8afd-ab2b333635a6 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:04.707606 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e8d6882-b42c-4377-8afd-ab2b333635a6 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:04.708148 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e8d6882-b42c-4377-8afd-ab2b333635a6 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:04.708838 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e8d6882-b42c-4377-8afd-ab2b333635a6 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:04.709284 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e8d6882-b42c-4377-8afd-ab2b333635a6 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:04.709697 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e8d6882-b42c-4377-8afd-ab2b333635a6 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:04.724675 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-3e8d6882-b42c-4377-8afd-ab2b333635a6 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] HTTP exception thrown: Instance 550ef045-da80-4060-96f5-88bfcbba7c2e could not be found. Aug 05 10:36:04.726201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3e8d6882-b42c-4377-8afd-ab2b333635a6 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Request method failure captured: Aug 05 10:36:04.726201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: DELETE /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e HTTP/1.1 Aug 05 10:36:04.726201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:36:04.726201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:36:04.726201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:36:04.726201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:36:04.726201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:36:04.726201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:36:04.726201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:36:04.726201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:04.726201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PBVvKEAgXr09AeP8_YyDN_3Qg97MKcRPfZfBv7XPmAMY6XGbdZkao3LWiN6xJSWxQo0C3sWAoUgAiuk9TXnxRXxqF632u9O-sRLYlUKqbNv6LTvL8-V362JLe2HbL5YUpqikP3hRhQT8BF6T22y6WTFPUrTUTtXvezcNTjWvs0YxMM Aug 05 10:36:04.726201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:36:04.726201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:36:04.726201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:36:04.726201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:36:04.726201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:36:04.726201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:36:04.726201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 40807f4af05048deae68cf3515433261 Aug 05 10:36:04.726201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeTestJSON-1698462425 Aug 05 10:36:04.726201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:36:04.726201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:36:04.727660 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_40807f4af05048deae68cf3515433261"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/40807f4af05048deae68cf3515433261"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40807f4af05048deae68cf3515433261"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40807f4af05048deae68cf3515433261"}]}] Aug 05 10:36:04.727660 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeTestJSON-1698462425 Aug 05 10:36:04.727660 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 40807f4af05048deae68cf3515433261 Aug 05 10:36:04.727660 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1698462425 Aug 05 10:36:04.727660 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeTestJSON-1698462425-project Aug 05 10:36:04.727660 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:36:04.727660 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:36:04.727660 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: 7e7eb355fac04252a4be1f8e60037924 Aug 05 10:36:04.727660 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeTestJSON-1698462425-project Aug 05 10:36:04.727660 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:36:04.727660 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Instance 550ef045-da80-4060-96f5-88bfcbba7c2e could not be found. Aug 05 10:36:04.727660 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': '550ef045-da80-4060-96f5-88bfcbba7c2e'} Aug 05 10:36:04.728487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:04.728487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:04.728487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:36:04.728487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:36:04.728487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:36:04.728487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:36:04.728487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:36:04.728487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:36:04.728487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:36:04.728487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:36:04.728487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 550ef045-da80-4060-96f5-88bfcbba7c2e could not be found. Aug 05 10:36:04.728487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:04.728487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:04.728487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:04.728487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:04.728487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:04.728487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:04.728487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:04.728487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:04.728487 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:04.729792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:04.729792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 10:36:04.729792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 10:36:04.729792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 10:36:04.729792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 10:36:04.729792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:36:04.729792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:36:04.729792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:36:04.729792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:04.729792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 550ef045-da80-4060-96f5-88bfcbba7c2e could not be found. Aug 05 10:36:04.729792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:04.729792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:04.729792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:04.729792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:04.729792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:04.729792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:04.729792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:04.729792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:04.729792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 550ef045-da80-4060-96f5-88bfcbba7c2e could not be found. Aug 05 10:36:04.729792 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:04.731520 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3e8d6882-b42c-4377-8afd-ab2b333635a6 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Returning 404 to user: Instance 550ef045-da80-4060-96f5-88bfcbba7c2e could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:04.731520 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3e8d6882-b42c-4377-8afd-ab2b333635a6 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "DELETE /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e" status: 404 len: 111 microversion: 2.1 time: 0.032121 Aug 05 10:36:04.731520 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 544/1061] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:36:04 2022] DELETE /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:36:04.737501 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-955e7c50-490f-48ae-9c1c-4b0ec47c417a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:04.738119 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-955e7c50-490f-48ae-9c1c-4b0ec47c417a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 550ef045-da80-4060-96f5-88bfcbba7c2e] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:04.739987 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=2 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:36:04.746579 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-955e7c50-490f-48ae-9c1c-4b0ec47c417a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:04.747232 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-955e7c50-490f-48ae-9c1c-4b0ec47c417a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:04.747672 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-955e7c50-490f-48ae-9c1c-4b0ec47c417a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:04.748370 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-955e7c50-490f-48ae-9c1c-4b0ec47c417a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:04.748816 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-955e7c50-490f-48ae-9c1c-4b0ec47c417a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:04.749240 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-955e7c50-490f-48ae-9c1c-4b0ec47c417a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:04.764120 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-955e7c50-490f-48ae-9c1c-4b0ec47c417a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] HTTP exception thrown: Instance 550ef045-da80-4060-96f5-88bfcbba7c2e could not be found. Aug 05 10:36:04.765757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-955e7c50-490f-48ae-9c1c-4b0ec47c417a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Request method failure captured: Aug 05 10:36:04.765757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e HTTP/1.1 Aug 05 10:36:04.765757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:36:04.765757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:36:04.765757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:36:04.765757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:36:04.765757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:36:04.765757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:36:04.765757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:36:04.765757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:04.765757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PBVvKEAgXr09AeP8_YyDN_3Qg97MKcRPfZfBv7XPmAMY6XGbdZkao3LWiN6xJSWxQo0C3sWAoUgAiuk9TXnxRXxqF632u9O-sRLYlUKqbNv6LTvL8-V362JLe2HbL5YUpqikP3hRhQT8BF6T22y6WTFPUrTUTtXvezcNTjWvs0YxMM Aug 05 10:36:04.765757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:36:04.765757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:36:04.765757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:36:04.765757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:36:04.765757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:36:04.765757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:36:04.765757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 40807f4af05048deae68cf3515433261 Aug 05 10:36:04.765757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-AttachVolumeTestJSON-1698462425 Aug 05 10:36:04.765757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:36:04.765757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:36:04.767536 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_40807f4af05048deae68cf3515433261"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/40807f4af05048deae68cf3515433261"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40807f4af05048deae68cf3515433261"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40807f4af05048deae68cf3515433261"}]}] Aug 05 10:36:04.767536 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-AttachVolumeTestJSON-1698462425 Aug 05 10:36:04.767536 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 40807f4af05048deae68cf3515433261 Aug 05 10:36:04.767536 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1698462425 Aug 05 10:36:04.767536 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-AttachVolumeTestJSON-1698462425-project Aug 05 10:36:04.767536 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:36:04.767536 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:36:04.767536 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: 7e7eb355fac04252a4be1f8e60037924 Aug 05 10:36:04.767536 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-AttachVolumeTestJSON-1698462425-project Aug 05 10:36:04.767536 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: > Aug 05 10:36:04.767536 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Instance 550ef045-da80-4060-96f5-88bfcbba7c2e could not be found. Aug 05 10:36:04.767536 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'id': '550ef045-da80-4060-96f5-88bfcbba7c2e'} Aug 05 10:36:04.768293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:04.768293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:04.768293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:36:04.768293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:36:04.768293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:36:04.768293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:36:04.768293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:36:04.768293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:36:04.768293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:36:04.768293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:36:04.768293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 550ef045-da80-4060-96f5-88bfcbba7c2e could not be found. Aug 05 10:36:04.768293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:04.768293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:04.768293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:04.768293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:04.768293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:04.768293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:04.768293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:04.768293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:04.768293 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:04.769602 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:04.769602 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:36:04.769602 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:36:04.769602 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:36:04.769602 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:36:04.769602 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:36:04.769602 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:04.769602 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 550ef045-da80-4060-96f5-88bfcbba7c2e could not be found. Aug 05 10:36:04.769602 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:04.769602 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:04.769602 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:04.769602 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:04.769602 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:04.769602 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:04.769602 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:04.769602 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:04.769602 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 550ef045-da80-4060-96f5-88bfcbba7c2e could not be found. Aug 05 10:36:04.769602 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:04.770990 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-955e7c50-490f-48ae-9c1c-4b0ec47c417a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Returning 404 to user: Instance 550ef045-da80-4060-96f5-88bfcbba7c2e could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:04.770990 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-955e7c50-490f-48ae-9c1c-4b0ec47c417a tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e" status: 404 len: 111 microversion: 2.1 time: 0.034586 Aug 05 10:36:04.770990 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 518/1062] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:36:04 2022] GET /compute/v2.1/servers/550ef045-da80-4060-96f5-88bfcbba7c2e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:36:05.920767 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9cf4cb40-a732-49b5-bda0-de0bf4552082 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:05.921304 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9cf4cb40-a732-49b5-bda0-de0bf4552082 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:05.929509 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9cf4cb40-a732-49b5-bda0-de0bf4552082 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:05.930028 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9cf4cb40-a732-49b5-bda0-de0bf4552082 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:05.930462 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9cf4cb40-a732-49b5-bda0-de0bf4552082 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:05.931212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9cf4cb40-a732-49b5-bda0-de0bf4552082 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:05.931668 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9cf4cb40-a732-49b5-bda0-de0bf4552082 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:05.932091 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9cf4cb40-a732-49b5-bda0-de0bf4552082 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:05.946311 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-9cf4cb40-a732-49b5-bda0-de0bf4552082 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] HTTP exception thrown: Instance 6cef9d70-01bd-4d04-829d-2495d889f34a could not be found. Aug 05 10:36:05.947898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9cf4cb40-a732-49b5-bda0-de0bf4552082 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Request method failure captured: Aug 05 10:36:05.947898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: DELETE /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a HTTP/1.1 Aug 05 10:36:05.947898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:36:05.947898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:36:05.947898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:36:05.947898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:36:05.947898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:36:05.947898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:36:05.947898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:36:05.947898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:05.947898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PBVvKEAgXr09AeP8_YyDN_3Qg97MKcRPfZfBv7XPmAMY6XGbdZkao3LWiN6xJSWxQo0C3sWAoUgAiuk9TXnxRXxqF632u9O-sRLYlUKqbNv6LTvL8-V362JLe2HbL5YUpqikP3hRhQT8BF6T22y6WTFPUrTUTtXvezcNTjWvs0YxMM Aug 05 10:36:05.947898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:36:05.947898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:36:05.947898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:36:05.947898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:36:05.947898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:36:05.947898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:36:05.947898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 40807f4af05048deae68cf3515433261 Aug 05 10:36:05.947898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeTestJSON-1698462425 Aug 05 10:36:05.947898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:36:05.947898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:36:05.949350 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_40807f4af05048deae68cf3515433261"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/40807f4af05048deae68cf3515433261"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40807f4af05048deae68cf3515433261"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40807f4af05048deae68cf3515433261"}]}] Aug 05 10:36:05.949350 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeTestJSON-1698462425 Aug 05 10:36:05.949350 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 40807f4af05048deae68cf3515433261 Aug 05 10:36:05.949350 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1698462425 Aug 05 10:36:05.949350 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeTestJSON-1698462425-project Aug 05 10:36:05.949350 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:36:05.949350 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:36:05.949350 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: 7e7eb355fac04252a4be1f8e60037924 Aug 05 10:36:05.949350 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeTestJSON-1698462425-project Aug 05 10:36:05.949350 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:36:05.949350 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Instance 6cef9d70-01bd-4d04-829d-2495d889f34a could not be found. Aug 05 10:36:05.949350 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': '6cef9d70-01bd-4d04-829d-2495d889f34a'} Aug 05 10:36:05.952690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:05.952690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:05.952690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:36:05.952690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:36:05.952690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:36:05.952690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:36:05.952690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:36:05.952690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:36:05.952690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:36:05.952690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:36:05.952690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cef9d70-01bd-4d04-829d-2495d889f34a could not be found. Aug 05 10:36:05.952690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:05.952690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:05.952690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:05.952690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:05.952690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:05.952690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:05.952690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:05.952690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:05.952690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:05.953949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:05.953949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 10:36:05.953949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 10:36:05.953949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 10:36:05.953949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 10:36:05.953949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:36:05.953949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:36:05.953949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:36:05.953949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:05.953949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cef9d70-01bd-4d04-829d-2495d889f34a could not be found. Aug 05 10:36:05.953949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:05.953949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:05.953949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:05.953949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:05.953949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:05.953949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:05.953949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:05.953949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:05.953949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cef9d70-01bd-4d04-829d-2495d889f34a could not be found. Aug 05 10:36:05.953949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:05.955322 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9cf4cb40-a732-49b5-bda0-de0bf4552082 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Returning 404 to user: Instance 6cef9d70-01bd-4d04-829d-2495d889f34a could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:05.955322 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9cf4cb40-a732-49b5-bda0-de0bf4552082 tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 404 len: 111 microversion: 2.1 time: 0.033564 Aug 05 10:36:05.955322 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 545/1063] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:36:05 2022] DELETE /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:36:05.958061 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-958e9f5b-0776-424d-9ac4-36fc00b48b4b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:05.958682 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-958e9f5b-0776-424d-9ac4-36fc00b48b4b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] [instance: 6cef9d70-01bd-4d04-829d-2495d889f34a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:05.965858 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-958e9f5b-0776-424d-9ac4-36fc00b48b4b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:05.966342 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-958e9f5b-0776-424d-9ac4-36fc00b48b4b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:05.966782 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-958e9f5b-0776-424d-9ac4-36fc00b48b4b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:05.967507 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-958e9f5b-0776-424d-9ac4-36fc00b48b4b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:05.967962 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-958e9f5b-0776-424d-9ac4-36fc00b48b4b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:05.968394 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-958e9f5b-0776-424d-9ac4-36fc00b48b4b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:05.982531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-958e9f5b-0776-424d-9ac4-36fc00b48b4b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] HTTP exception thrown: Instance 6cef9d70-01bd-4d04-829d-2495d889f34a could not be found. Aug 05 10:36:05.984140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-958e9f5b-0776-424d-9ac4-36fc00b48b4b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Request method failure captured: Aug 05 10:36:05.984140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a HTTP/1.1 Aug 05 10:36:05.984140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:36:05.984140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:36:05.984140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:36:05.984140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:36:05.984140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:36:05.984140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:36:05.984140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:36:05.984140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:05.984140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PBVvKEAgXr09AeP8_YyDN_3Qg97MKcRPfZfBv7XPmAMY6XGbdZkao3LWiN6xJSWxQo0C3sWAoUgAiuk9TXnxRXxqF632u9O-sRLYlUKqbNv6LTvL8-V362JLe2HbL5YUpqikP3hRhQT8BF6T22y6WTFPUrTUTtXvezcNTjWvs0YxMM Aug 05 10:36:05.984140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:36:05.984140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:36:05.984140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:36:05.984140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:36:05.984140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:36:05.984140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:36:05.984140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 40807f4af05048deae68cf3515433261 Aug 05 10:36:05.984140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-AttachVolumeTestJSON-1698462425 Aug 05 10:36:05.984140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:36:05.984140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:36:05.985657 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_40807f4af05048deae68cf3515433261"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/40807f4af05048deae68cf3515433261"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40807f4af05048deae68cf3515433261"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40807f4af05048deae68cf3515433261"}]}] Aug 05 10:36:05.985657 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-AttachVolumeTestJSON-1698462425 Aug 05 10:36:05.985657 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 40807f4af05048deae68cf3515433261 Aug 05 10:36:05.985657 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1698462425 Aug 05 10:36:05.985657 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-AttachVolumeTestJSON-1698462425-project Aug 05 10:36:05.985657 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:36:05.985657 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:36:05.985657 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: 7e7eb355fac04252a4be1f8e60037924 Aug 05 10:36:05.985657 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-AttachVolumeTestJSON-1698462425-project Aug 05 10:36:05.985657 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: > Aug 05 10:36:05.985657 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Instance 6cef9d70-01bd-4d04-829d-2495d889f34a could not be found. Aug 05 10:36:05.985657 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'id': '6cef9d70-01bd-4d04-829d-2495d889f34a'} Aug 05 10:36:05.986400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:05.986400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:05.986400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:36:05.986400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:36:05.986400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:36:05.986400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:36:05.986400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:36:05.986400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:36:05.986400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:36:05.986400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:36:05.986400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cef9d70-01bd-4d04-829d-2495d889f34a could not be found. Aug 05 10:36:05.986400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:05.986400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:05.986400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:05.986400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:05.986400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:05.986400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:05.986400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:05.986400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:05.986400 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:05.988319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:05.988319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:36:05.988319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:36:05.988319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:36:05.988319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:36:05.988319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:36:05.988319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:05.988319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cef9d70-01bd-4d04-829d-2495d889f34a could not be found. Aug 05 10:36:05.988319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:05.988319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:05.988319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:05.988319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:05.988319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:05.988319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:05.988319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:05.988319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:05.988319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cef9d70-01bd-4d04-829d-2495d889f34a could not be found. Aug 05 10:36:05.988319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:05.989936 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-958e9f5b-0776-424d-9ac4-36fc00b48b4b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] Returning 404 to user: Instance 6cef9d70-01bd-4d04-829d-2495d889f34a could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:05.989936 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-958e9f5b-0776-424d-9ac4-36fc00b48b4b tempest-AttachVolumeTestJSON-1698462425 tempest-AttachVolumeTestJSON-1698462425-project] 10.222.0.40 "GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a" status: 404 len: 111 microversion: 2.1 time: 0.031303 Aug 05 10:36:05.989936 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 519/1064] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:36:05 2022] GET /compute/v2.1/servers/6cef9d70-01bd-4d04-829d-2495d889f34a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:36:08.741048 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9fd527ed-619f-4d9d-992d-e3f6c25cf463 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:08.741631 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9fd527ed-619f-4d9d-992d-e3f6c25cf463 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:08.749584 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9fd527ed-619f-4d9d-992d-e3f6c25cf463 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:08.750052 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9fd527ed-619f-4d9d-992d-e3f6c25cf463 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:08.750470 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9fd527ed-619f-4d9d-992d-e3f6c25cf463 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:08.751190 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9fd527ed-619f-4d9d-992d-e3f6c25cf463 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:08.751635 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9fd527ed-619f-4d9d-992d-e3f6c25cf463 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:08.752164 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9fd527ed-619f-4d9d-992d-e3f6c25cf463 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:08.776769 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9fd527ed-619f-4d9d-992d-e3f6c25cf463 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1/ips" status: 200 len: 150 microversion: 2.1 time: 0.039204 Aug 05 10:36:08.777525 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 546/1065] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 5 10:36:08 2022] GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:36:10.217606 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f6351632-2a7a-4bbf-b73b-c2dcd9fd6868 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f163ec38-7a7b-42af-a170-cf892803e76a"}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:36:10.220156 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f6351632-2a7a-4bbf-b73b-c2dcd9fd6868 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:10.233092 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f6351632-2a7a-4bbf-b73b-c2dcd9fd6868 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:10.233756 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f6351632-2a7a-4bbf-b73b-c2dcd9fd6868 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:10.234080 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f6351632-2a7a-4bbf-b73b-c2dcd9fd6868 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:10.234830 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f6351632-2a7a-4bbf-b73b-c2dcd9fd6868 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:10.235280 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f6351632-2a7a-4bbf-b73b-c2dcd9fd6868 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:10.235738 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f6351632-2a7a-4bbf-b73b-c2dcd9fd6868 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:10.705054 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f6351632-2a7a-4bbf-b73b-c2dcd9fd6868 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "POST /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.491612 Aug 05 10:36:10.711234 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 520/1066] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 10:36:10 2022] POST /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1/os-volume_attachments => generated 194 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:36:10.712491 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3b66e323-00ff-48a1-b545-bf9df2aed957 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Action: 'create', calling method: .version_select at 0x7f7327440820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1951396922"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:36:11.132666 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3b66e323-00ff-48a1-b545-bf9df2aed957 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.539443 Aug 05 10:36:11.133287 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 547/1067] 10.222.0.40 () {60 vars in 1155 bytes} [Fri Aug 5 10:36:10 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 541 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 05 10:36:11.148038 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-84e029c0-0150-4a19-ba1e-961e137b11d8 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Calling method '.version_select at 0x7f732765bc10>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:11.199932 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-84e029c0-0150-4a19-ba1e-961e137b11d8 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/54f30ac3-7730-4f06-8fa0-d713460c16be" status: 200 len: 345 microversion: 2.1 time: 0.057172 Aug 05 10:36:11.200555 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 521/1068] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 10:36:11 2022] GET /compute/v2.1/os-volumes/54f30ac3-7730-4f06-8fa0-d713460c16be => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:36:12.215539 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5d94ff7f-1ddb-41c3-b96c-989590199f08 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Calling method '.version_select at 0x7f73276db310>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:12.268900 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5d94ff7f-1ddb-41c3-b96c-989590199f08 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/54f30ac3-7730-4f06-8fa0-d713460c16be" status: 200 len: 346 microversion: 2.1 time: 0.057724 Aug 05 10:36:12.269610 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 548/1069] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 10:36:12 2022] GET /compute/v2.1/os-volumes/54f30ac3-7730-4f06-8fa0-d713460c16be => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:36:12.283023 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-406c9846-3937-4c69-986b-cfef294fc790 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Action: 'create', calling method: .version_select at 0x7f732775a700>, body: {"snapshot": {"volume_id": "54f30ac3-7730-4f06-8fa0-d713460c16be", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1693366565"}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:36:12.448567 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-406c9846-3937-4c69-986b-cfef294fc790 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.169930 Aug 05 10:36:12.449168 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 522/1070] 10.222.0.40 () {60 vars in 1162 bytes} [Fri Aug 5 10:36:12 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:36:12.459906 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d341c190-0436-422a-9b20-f158e433e4fc tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Calling method '.version_select at 0x7f732c0e2d30>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:12.494125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d341c190-0436-422a-9b20-f158e433e4fc tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/4c92f3ba-aff3-4964-ad74-54f2ca4a61a5" status: 200 len: 287 microversion: 2.1 time: 0.037950 Aug 05 10:36:12.494682 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 549/1071] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 5 10:36:12 2022] GET /compute/v2.1/os-snapshots/4c92f3ba-aff3-4964-ad74-54f2ca4a61a5 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:36:12.505818 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-979d30da-e227-4352-9c69-854522433f74 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Calling method '.version_select at 0x7f732775aaf0>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:12.539926 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-979d30da-e227-4352-9c69-854522433f74 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.037923 Aug 05 10:36:12.540493 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 523/1072] 10.222.0.40 () {58 vars in 1140 bytes} [Fri Aug 5 10:36:12 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:36:12.551841 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e0ffdf99-2d1a-47bb-bc6d-06f7254ed48e tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Calling method '.version_select at 0x7f732dabfee0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:12.582476 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e0ffdf99-2d1a-47bb-bc6d-06f7254ed48e tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/4c92f3ba-aff3-4964-ad74-54f2ca4a61a5" status: 200 len: 287 microversion: 2.1 time: 0.034414 Aug 05 10:36:12.583075 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 550/1073] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 5 10:36:12 2022] GET /compute/v2.1/os-snapshots/4c92f3ba-aff3-4964-ad74-54f2ca4a61a5 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:36:13.600531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ab96b29f-6907-4d63-a0c6-c9fee30e182d tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Calling method '.version_select at 0x7f732762fc10>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:13.640231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ab96b29f-6907-4d63-a0c6-c9fee30e182d tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/4c92f3ba-aff3-4964-ad74-54f2ca4a61a5" status: 200 len: 287 microversion: 2.1 time: 0.046844 Aug 05 10:36:13.641147 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 524/1074] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 5 10:36:13 2022] GET /compute/v2.1/os-snapshots/4c92f3ba-aff3-4964-ad74-54f2ca4a61a5 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:36:13.982177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 10:36:13.982716 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Fri Aug 5 10:36:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 10:36:14.658788 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-544f95dd-8040-40fb-be8e-dc52356b5c64 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Calling method '.version_select at 0x7f732760f280>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:14.693756 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-544f95dd-8040-40fb-be8e-dc52356b5c64 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/4c92f3ba-aff3-4964-ad74-54f2ca4a61a5" status: 200 len: 287 microversion: 2.1 time: 0.042494 Aug 05 10:36:14.694475 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 551/1075] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 5 10:36:14 2022] GET /compute/v2.1/os-snapshots/4c92f3ba-aff3-4964-ad74-54f2ca4a61a5 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:36:15.708691 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-3d3f3f8e-aa21-449f-a86e-60014d21e633 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Calling method '.version_select at 0x7f732765bd30>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:15.739360 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-3d3f3f8e-aa21-449f-a86e-60014d21e633 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/4c92f3ba-aff3-4964-ad74-54f2ca4a61a5" status: 200 len: 287 microversion: 2.1 time: 0.035913 Aug 05 10:36:15.739933 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 525/1076] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 5 10:36:15 2022] GET /compute/v2.1/os-snapshots/4c92f3ba-aff3-4964-ad74-54f2ca4a61a5 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:36:16.756357 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-100ee535-7b60-4448-80a1-f7c09611c73c tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Calling method '.version_select at 0x7f73276c38b0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:16.797841 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-100ee535-7b60-4448-80a1-f7c09611c73c tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/4c92f3ba-aff3-4964-ad74-54f2ca4a61a5" status: 200 len: 288 microversion: 2.1 time: 0.047001 Aug 05 10:36:16.798398 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 552/1077] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 5 10:36:16 2022] GET /compute/v2.1/os-snapshots/4c92f3ba-aff3-4964-ad74-54f2ca4a61a5 => generated 288 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:36:16.809969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-6c089eae-52f8-4038-afd5-49cebf0fcc17 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Calling method '.version_select at 0x7f732775adc0>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:16.874047 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-6c089eae-52f8-4038-afd5-49cebf0fcc17 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/4c92f3ba-aff3-4964-ad74-54f2ca4a61a5" status: 202 len: 0 microversion: 2.1 time: 0.068350 Aug 05 10:36:16.874676 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 526/1078] 10.222.0.40 () {58 vars in 1254 bytes} [Fri Aug 5 10:36:16 2022] DELETE /compute/v2.1/os-snapshots/4c92f3ba-aff3-4964-ad74-54f2ca4a61a5 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:36:16.883225 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f59aa5cd-9c26-4dac-a01d-eb2c5b63547b tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Calling method '.version_select at 0x7f732c0e23a0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:16.913456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f59aa5cd-9c26-4dac-a01d-eb2c5b63547b tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/4c92f3ba-aff3-4964-ad74-54f2ca4a61a5" status: 200 len: 287 microversion: 2.1 time: 0.034126 Aug 05 10:36:16.914066 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 553/1079] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 5 10:36:16 2022] GET /compute/v2.1/os-snapshots/4c92f3ba-aff3-4964-ad74-54f2ca4a61a5 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:36:17.929041 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-9477bbe8-b6b9-4d1c-94f3-bf5bb902254e tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Calling method '.version_select at 0x7f732c22e9d0>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:17.956630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-9477bbe8-b6b9-4d1c-94f3-bf5bb902254e tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] HTTP exception thrown: Snapshot 4c92f3ba-aff3-4964-ad74-54f2ca4a61a5 could not be found. Aug 05 10:36:17.959021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-9477bbe8-b6b9-4d1c-94f3-bf5bb902254e tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Request method failure captured: Aug 05 10:36:17.959021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: GET /compute/v2.1/os-snapshots/4c92f3ba-aff3-4964-ad74-54f2ca4a61a5 HTTP/1.1 Aug 05 10:36:17.959021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:36:17.959021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:36:17.959021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:36:17.959021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:36:17.959021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:36:17.959021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:36:17.959021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:36:17.959021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:17.959021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PKaGIZIguSE8a-h4GnM9zzfxuQi3nLN35U0QLlwGHrz13qW2iw5izFngJ6G_ndre3mz7wtXPB2J7nfwg9PezFvg29EfpVvXSg82tEACpJ3uLhuxNdVq6ag5RgC-FfzBk8JC9mbVFUgpVjAVhKfgfJWnS-8RFyixUwagbysQV1qBK08 Aug 05 10:36:17.959021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:36:17.959021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:36:17.959021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:36:17.959021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:36:17.959021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:36:17.959021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:36:17.959021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: feb60e9ea1de4b5382ee941d4d5f5454 Aug 05 10:36:17.959021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1428630234 Aug 05 10:36:17.959021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:36:17.959021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:36:17.960664 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_feb60e9ea1de4b5382ee941d4d5f5454"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/feb60e9ea1de4b5382ee941d4d5f5454"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/feb60e9ea1de4b5382ee941d4d5f5454"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/feb60e9ea1de4b5382ee941d4d5f5454"}]}] Aug 05 10:36:17.960664 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1428630234 Aug 05 10:36:17.960664 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: feb60e9ea1de4b5382ee941d4d5f5454 Aug 05 10:36:17.960664 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1428630234 Aug 05 10:36:17.960664 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-VolumesSnapshotsTestJSON-1428630234-project Aug 05 10:36:17.960664 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:36:17.960664 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:36:17.960664 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: fe0bc9f355f947cbbf8b8a638d7a87da Aug 05 10:36:17.960664 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1428630234-project Aug 05 10:36:17.960664 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: Aug 05 10:36:17.960664 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Snapshot 4c92f3ba-aff3-4964-ad74-54f2ca4a61a5 could not be found. Aug 05 10:36:17.960664 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'id': '4c92f3ba-aff3-4964-ad74-54f2ca4a61a5'} Aug 05 10:36:17.960664 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:17.961655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:17.961655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 05 10:36:17.961655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 05 10:36:17.961655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 05 10:36:17.961655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 05 10:36:17.961655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 05 10:36:17.961655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 05 10:36:17.961655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 10:36:17.961655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 10:36:17.961655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 10:36:17.961655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 10:36:17.961655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 10:36:17.961655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 10:36:17.961655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 10:36:17.961655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 10:36:17.961655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4c92f3ba-aff3-4964-ad74-54f2ca4a61a5 could not be found. (HTTP 404) (Request-ID: req-917217e5-6773-4595-bb76-cdb4dc6fe546) Aug 05 10:36:17.961655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:17.961655 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:17.963027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:17.963027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:17.963027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 05 10:36:17.963027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 05 10:36:17.963027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 10:36:17.963027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 10:36:17.963027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 05 10:36:17.963027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 05 10:36:17.963027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 10:36:17.963027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 10:36:17.963027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 05 10:36:17.963027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 05 10:36:17.963027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 05 10:36:17.963027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 05 10:36:17.963027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 05 10:36:17.963027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 05 10:36:17.963027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 10:36:17.963027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 10:36:17.963027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 10:36:17.964494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 10:36:17.964494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 10:36:17.964494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 10:36:17.964494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 10:36:17.964494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 10:36:17.964494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4c92f3ba-aff3-4964-ad74-54f2ca4a61a5 could not be found. Aug 05 10:36:17.964494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:17.964494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:17.964494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:17.964494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:17.964494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:17.964494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:17.964494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:17.964494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:17.964494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 10:36:17.964494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 10:36:17.964494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:17.964494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:17.964494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 05 10:36:17.964494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:17.966274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4c92f3ba-aff3-4964-ad74-54f2ca4a61a5 could not be found. Aug 05 10:36:17.966274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:17.966274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:17.966274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:17.966274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:17.966274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:17.966274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:17.966274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:17.966274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:17.966274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4c92f3ba-aff3-4964-ad74-54f2ca4a61a5 could not be found. Aug 05 10:36:17.966274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:17.966274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-9477bbe8-b6b9-4d1c-94f3-bf5bb902254e tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Returning 404 to user: Snapshot 4c92f3ba-aff3-4964-ad74-54f2ca4a61a5 could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:17.966274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-9477bbe8-b6b9-4d1c-94f3-bf5bb902254e tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/4c92f3ba-aff3-4964-ad74-54f2ca4a61a5" status: 404 len: 111 microversion: 2.1 time: 0.037612 Aug 05 10:36:17.967205 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 527/1080] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 5 10:36:17 2022] GET /compute/v2.1/os-snapshots/4c92f3ba-aff3-4964-ad74-54f2ca4a61a5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:36:17.969780 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1ffe7a65-99c7-4c8b-8dee-35a77f62c226 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Calling method '.version_select at 0x7f7327769ee0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:18.035836 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1ffe7a65-99c7-4c8b-8dee-35a77f62c226 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/54f30ac3-7730-4f06-8fa0-d713460c16be" status: 202 len: 0 microversion: 2.1 time: 0.070004 Aug 05 10:36:18.036417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 554/1081] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 5 10:36:17 2022] DELETE /compute/v2.1/os-volumes/54f30ac3-7730-4f06-8fa0-d713460c16be => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:36:18.045014 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-05d36074-fc72-43fe-9ced-8d4cd22ef2ff tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Calling method '.version_select at 0x7f732775a0d0>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:18.100728 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-05d36074-fc72-43fe-9ced-8d4cd22ef2ff tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/54f30ac3-7730-4f06-8fa0-d713460c16be" status: 200 len: 345 microversion: 2.1 time: 0.059742 Aug 05 10:36:18.101482 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 528/1082] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 10:36:18 2022] GET /compute/v2.1/os-volumes/54f30ac3-7730-4f06-8fa0-d713460c16be => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:36:18.408928 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-eadf0d96-8eb0-4de8-a802-0811e559fe76 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:18.409430 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-eadf0d96-8eb0-4de8-a802-0811e559fe76 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:18.415884 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eadf0d96-8eb0-4de8-a802-0811e559fe76 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:18.416372 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eadf0d96-8eb0-4de8-a802-0811e559fe76 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:18.416802 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eadf0d96-8eb0-4de8-a802-0811e559fe76 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:18.417497 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eadf0d96-8eb0-4de8-a802-0811e559fe76 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:18.417953 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eadf0d96-8eb0-4de8-a802-0811e559fe76 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:18.418376 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eadf0d96-8eb0-4de8-a802-0811e559fe76 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:18.420938 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:36:18.505329 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-eadf0d96-8eb0-4de8-a802-0811e559fe76 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lazy-loading 'services' on Instance uuid 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:36:18.611470 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-eadf0d96-8eb0-4de8-a802-0811e559fe76 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1/os-volume_attachments/f163ec38-7a7b-42af-a170-cf892803e76a" status: 202 len: 0 microversion: 2.1 time: 0.206379 Aug 05 10:36:18.612258 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 555/1083] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 5 10:36:18 2022] DELETE /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1/os-volume_attachments/f163ec38-7a7b-42af-a170-cf892803e76a => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:36:18.621695 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-eace3516-f969-4b3c-b222-599fb4085bb5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:18.624015 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-eace3516-f969-4b3c-b222-599fb4085bb5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:18.631540 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-eace3516-f969-4b3c-b222-599fb4085bb5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:18.632097 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-eace3516-f969-4b3c-b222-599fb4085bb5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:18.632673 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-eace3516-f969-4b3c-b222-599fb4085bb5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:18.633395 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-eace3516-f969-4b3c-b222-599fb4085bb5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:18.633843 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-eace3516-f969-4b3c-b222-599fb4085bb5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:18.634266 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-eace3516-f969-4b3c-b222-599fb4085bb5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:18.669875 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-eace3516-f969-4b3c-b222-599fb4085bb5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052454 Aug 05 10:36:18.670434 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 529/1084] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 10:36:18 2022] GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:36:19.121202 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-22e17a76-14ab-4dbe-bc31-97358b5be716 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Calling method '.version_select at 0x7f7327708ee0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:19.163343 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-22e17a76-14ab-4dbe-bc31-97358b5be716 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] HTTP exception thrown: Volume 54f30ac3-7730-4f06-8fa0-d713460c16be could not be found. Aug 05 10:36:19.177232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-22e17a76-14ab-4dbe-bc31-97358b5be716 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Request method failure captured: Aug 05 10:36:19.177232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/os-volumes/54f30ac3-7730-4f06-8fa0-d713460c16be HTTP/1.1 Aug 05 10:36:19.177232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:36:19.177232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:36:19.177232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:36:19.177232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:36:19.177232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:36:19.177232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:36:19.177232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:36:19.177232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:19.177232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PKaGIZIguSE8a-h4GnM9zzfxuQi3nLN35U0QLlwGHrz13qW2iw5izFngJ6G_ndre3mz7wtXPB2J7nfwg9PezFvg29EfpVvXSg82tEACpJ3uLhuxNdVq6ag5RgC-FfzBk8JC9mbVFUgpVjAVhKfgfJWnS-8RFyixUwagbysQV1qBK08 Aug 05 10:36:19.177232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:36:19.177232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:36:19.177232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:36:19.177232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:36:19.177232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:36:19.177232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:36:19.177232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: feb60e9ea1de4b5382ee941d4d5f5454 Aug 05 10:36:19.177232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1428630234 Aug 05 10:36:19.177232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:36:19.177232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:36:19.178772 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_feb60e9ea1de4b5382ee941d4d5f5454"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/feb60e9ea1de4b5382ee941d4d5f5454"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/feb60e9ea1de4b5382ee941d4d5f5454"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/feb60e9ea1de4b5382ee941d4d5f5454"}]}] Aug 05 10:36:19.178772 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1428630234 Aug 05 10:36:19.178772 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: feb60e9ea1de4b5382ee941d4d5f5454 Aug 05 10:36:19.178772 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1428630234 Aug 05 10:36:19.178772 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesSnapshotsTestJSON-1428630234-project Aug 05 10:36:19.178772 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:36:19.178772 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:36:19.178772 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: fe0bc9f355f947cbbf8b8a638d7a87da Aug 05 10:36:19.178772 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1428630234-project Aug 05 10:36:19.178772 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: Aug 05 10:36:19.178772 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Volume 54f30ac3-7730-4f06-8fa0-d713460c16be could not be found. Aug 05 10:36:19.178772 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': '54f30ac3-7730-4f06-8fa0-d713460c16be'} Aug 05 10:36:19.178772 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:19.179865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:19.179865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 10:36:19.179865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 10:36:19.179865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 10:36:19.179865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 10:36:19.179865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 10:36:19.179865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 10:36:19.179865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 10:36:19.179865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 10:36:19.179865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 10:36:19.179865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 10:36:19.179865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 10:36:19.179865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 10:36:19.179865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 10:36:19.179865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 10:36:19.179865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 54f30ac3-7730-4f06-8fa0-d713460c16be could not be found. (HTTP 404) (Request-ID: req-4dca2816-94d3-4d34-8163-25f221f40072) Aug 05 10:36:19.179865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:19.179865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:19.179865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:19.181077 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:19.181077 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 10:36:19.181077 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 10:36:19.181077 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 10:36:19.181077 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 10:36:19.181077 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 10:36:19.181077 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 10:36:19.181077 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 10:36:19.181077 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 10:36:19.181077 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 10:36:19.181077 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 10:36:19.181077 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 10:36:19.181077 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 10:36:19.181077 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 10:36:19.181077 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 10:36:19.181077 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 10:36:19.181077 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 10:36:19.181077 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 10:36:19.181077 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 10:36:19.182196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 10:36:19.182196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 10:36:19.182196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 10:36:19.182196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 10:36:19.182196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 54f30ac3-7730-4f06-8fa0-d713460c16be could not be found. Aug 05 10:36:19.182196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:19.182196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:19.182196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:19.182196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:19.182196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:19.182196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:19.182196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:19.182196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:19.182196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 10:36:19.182196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 10:36:19.182196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:19.182196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:19.182196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 10:36:19.182196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:19.183385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 54f30ac3-7730-4f06-8fa0-d713460c16be could not be found. Aug 05 10:36:19.183385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:19.183385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:19.183385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:19.183385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:19.183385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:19.183385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:19.183385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:19.183385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:19.183385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 54f30ac3-7730-4f06-8fa0-d713460c16be could not be found. Aug 05 10:36:19.183385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:19.183385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-22e17a76-14ab-4dbe-bc31-97358b5be716 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Returning 404 to user: Volume 54f30ac3-7730-4f06-8fa0-d713460c16be could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:19.183385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-22e17a76-14ab-4dbe-bc31-97358b5be716 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/54f30ac3-7730-4f06-8fa0-d713460c16be" status: 404 len: 109 microversion: 2.1 time: 0.065434 Aug 05 10:36:19.183385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 556/1085] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 10:36:19 2022] GET /compute/v2.1/os-volumes/54f30ac3-7730-4f06-8fa0-d713460c16be => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:36:19.193117 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b3a00af9-55bc-4d9e-a7c6-e8d92cdf85e6 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Calling method '.version_select at 0x7f732775a820>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:19.223066 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-b3a00af9-55bc-4d9e-a7c6-e8d92cdf85e6 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] HTTP exception thrown: Volume 54f30ac3-7730-4f06-8fa0-d713460c16be could not be found. Aug 05 10:36:19.225519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b3a00af9-55bc-4d9e-a7c6-e8d92cdf85e6 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Request method failure captured: Aug 05 10:36:19.225519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: DELETE /compute/v2.1/os-volumes/54f30ac3-7730-4f06-8fa0-d713460c16be HTTP/1.1 Aug 05 10:36:19.225519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:36:19.225519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:36:19.225519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:36:19.225519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:36:19.225519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:36:19.225519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:36:19.225519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:36:19.225519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:19.225519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PKaGIZIguSE8a-h4GnM9zzfxuQi3nLN35U0QLlwGHrz13qW2iw5izFngJ6G_ndre3mz7wtXPB2J7nfwg9PezFvg29EfpVvXSg82tEACpJ3uLhuxNdVq6ag5RgC-FfzBk8JC9mbVFUgpVjAVhKfgfJWnS-8RFyixUwagbysQV1qBK08 Aug 05 10:36:19.225519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:36:19.225519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:36:19.225519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:36:19.225519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:36:19.225519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:36:19.225519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:36:19.225519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: feb60e9ea1de4b5382ee941d4d5f5454 Aug 05 10:36:19.225519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1428630234 Aug 05 10:36:19.225519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:36:19.225519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:36:19.227365 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_feb60e9ea1de4b5382ee941d4d5f5454"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/feb60e9ea1de4b5382ee941d4d5f5454"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/feb60e9ea1de4b5382ee941d4d5f5454"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/feb60e9ea1de4b5382ee941d4d5f5454"}]}] Aug 05 10:36:19.227365 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1428630234 Aug 05 10:36:19.227365 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: feb60e9ea1de4b5382ee941d4d5f5454 Aug 05 10:36:19.227365 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1428630234 Aug 05 10:36:19.227365 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-VolumesSnapshotsTestJSON-1428630234-project Aug 05 10:36:19.227365 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:36:19.227365 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:36:19.227365 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: fe0bc9f355f947cbbf8b8a638d7a87da Aug 05 10:36:19.227365 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1428630234-project Aug 05 10:36:19.227365 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: Aug 05 10:36:19.227365 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Volume 54f30ac3-7730-4f06-8fa0-d713460c16be could not be found. Aug 05 10:36:19.227365 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'id': '54f30ac3-7730-4f06-8fa0-d713460c16be'} Aug 05 10:36:19.227365 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:19.228389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:19.228389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 10:36:19.228389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 10:36:19.228389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 10:36:19.228389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 10:36:19.228389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 10:36:19.228389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 10:36:19.228389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 10:36:19.228389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 10:36:19.228389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 10:36:19.228389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 10:36:19.228389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 10:36:19.228389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 10:36:19.228389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 10:36:19.228389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 10:36:19.228389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 54f30ac3-7730-4f06-8fa0-d713460c16be could not be found. (HTTP 404) (Request-ID: req-9f0d5c9d-1b1a-4716-919e-2ac7d95e4720) Aug 05 10:36:19.228389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:19.228389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:19.228389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:19.230543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:19.230543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 10:36:19.230543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 10:36:19.230543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 10:36:19.230543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 10:36:19.230543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 10:36:19.230543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 10:36:19.230543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 10:36:19.230543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 10:36:19.230543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 10:36:19.230543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 10:36:19.230543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 10:36:19.230543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 10:36:19.230543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 10:36:19.230543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 10:36:19.230543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 10:36:19.230543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 10:36:19.230543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 10:36:19.230543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 10:36:19.232392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 10:36:19.232392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 10:36:19.232392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 10:36:19.232392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 10:36:19.232392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 54f30ac3-7730-4f06-8fa0-d713460c16be could not be found. Aug 05 10:36:19.232392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:19.232392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:19.232392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:19.232392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:19.232392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:19.232392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:19.232392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:19.232392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:19.232392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 10:36:19.232392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 10:36:19.232392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:19.232392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:19.232392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 10:36:19.232392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:19.233761 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 54f30ac3-7730-4f06-8fa0-d713460c16be could not be found. Aug 05 10:36:19.233761 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:19.233761 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:19.233761 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:19.233761 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:19.233761 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:19.233761 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:19.233761 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:19.233761 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:19.233761 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 54f30ac3-7730-4f06-8fa0-d713460c16be could not be found. Aug 05 10:36:19.233761 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:19.235330 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b3a00af9-55bc-4d9e-a7c6-e8d92cdf85e6 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Returning 404 to user: Volume 54f30ac3-7730-4f06-8fa0-d713460c16be could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:19.236169 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b3a00af9-55bc-4d9e-a7c6-e8d92cdf85e6 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/54f30ac3-7730-4f06-8fa0-d713460c16be" status: 404 len: 109 microversion: 2.1 time: 0.047010 Aug 05 10:36:19.236810 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 530/1086] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 5 10:36:19 2022] DELETE /compute/v2.1/os-volumes/54f30ac3-7730-4f06-8fa0-d713460c16be => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:36:19.245141 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ec7bdd0e-f0a6-4fb6-913b-d125c2ef4d95 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Calling method '.version_select at 0x7f73276cb940>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:19.274072 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-ec7bdd0e-f0a6-4fb6-913b-d125c2ef4d95 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] HTTP exception thrown: Volume 54f30ac3-7730-4f06-8fa0-d713460c16be could not be found. Aug 05 10:36:19.276349 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ec7bdd0e-f0a6-4fb6-913b-d125c2ef4d95 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Request method failure captured: Aug 05 10:36:19.276349 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/os-volumes/54f30ac3-7730-4f06-8fa0-d713460c16be HTTP/1.1 Aug 05 10:36:19.276349 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:36:19.276349 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:36:19.276349 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:36:19.276349 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:36:19.276349 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:36:19.276349 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:36:19.276349 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:36:19.276349 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:19.276349 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PKaGIZIguSE8a-h4GnM9zzfxuQi3nLN35U0QLlwGHrz13qW2iw5izFngJ6G_ndre3mz7wtXPB2J7nfwg9PezFvg29EfpVvXSg82tEACpJ3uLhuxNdVq6ag5RgC-FfzBk8JC9mbVFUgpVjAVhKfgfJWnS-8RFyixUwagbysQV1qBK08 Aug 05 10:36:19.276349 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:36:19.276349 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:36:19.276349 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:36:19.276349 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:36:19.276349 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:36:19.276349 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:36:19.276349 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: feb60e9ea1de4b5382ee941d4d5f5454 Aug 05 10:36:19.276349 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1428630234 Aug 05 10:36:19.276349 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:36:19.276349 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:36:19.278149 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_feb60e9ea1de4b5382ee941d4d5f5454"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/feb60e9ea1de4b5382ee941d4d5f5454"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/feb60e9ea1de4b5382ee941d4d5f5454"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/feb60e9ea1de4b5382ee941d4d5f5454"}]}] Aug 05 10:36:19.278149 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1428630234 Aug 05 10:36:19.278149 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: feb60e9ea1de4b5382ee941d4d5f5454 Aug 05 10:36:19.278149 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1428630234 Aug 05 10:36:19.278149 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesSnapshotsTestJSON-1428630234-project Aug 05 10:36:19.278149 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:36:19.278149 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:36:19.278149 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: fe0bc9f355f947cbbf8b8a638d7a87da Aug 05 10:36:19.278149 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1428630234-project Aug 05 10:36:19.278149 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: Aug 05 10:36:19.278149 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Volume 54f30ac3-7730-4f06-8fa0-d713460c16be could not be found. Aug 05 10:36:19.278149 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': '54f30ac3-7730-4f06-8fa0-d713460c16be'} Aug 05 10:36:19.278149 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:19.279145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:19.279145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 10:36:19.279145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 10:36:19.279145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 10:36:19.279145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 10:36:19.279145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 10:36:19.279145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 10:36:19.279145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 10:36:19.279145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 10:36:19.279145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 10:36:19.279145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 10:36:19.279145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 10:36:19.279145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 10:36:19.279145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 10:36:19.279145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 10:36:19.279145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 54f30ac3-7730-4f06-8fa0-d713460c16be could not be found. (HTTP 404) (Request-ID: req-fa520318-26fb-42b7-91fd-f9e0c6a5451a) Aug 05 10:36:19.279145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:19.279145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:19.279145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:19.280582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:19.280582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 10:36:19.280582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 10:36:19.280582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 10:36:19.280582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 10:36:19.280582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 10:36:19.280582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 10:36:19.280582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 10:36:19.280582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 10:36:19.280582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 10:36:19.280582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 10:36:19.280582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 10:36:19.280582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 10:36:19.280582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 10:36:19.280582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 10:36:19.280582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 10:36:19.280582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 10:36:19.280582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 10:36:19.280582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 10:36:19.282030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 10:36:19.282030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 10:36:19.282030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 10:36:19.282030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 10:36:19.282030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 54f30ac3-7730-4f06-8fa0-d713460c16be could not be found. Aug 05 10:36:19.282030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:19.282030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:19.282030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:19.282030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:19.282030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:19.282030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:19.282030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:19.282030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:19.282030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 10:36:19.282030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 10:36:19.282030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:19.282030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:19.282030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 10:36:19.282030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:19.283485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 54f30ac3-7730-4f06-8fa0-d713460c16be could not be found. Aug 05 10:36:19.283485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:19.283485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:19.283485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:19.283485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:19.283485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:19.283485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:19.283485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:19.283485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:19.283485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 54f30ac3-7730-4f06-8fa0-d713460c16be could not be found. Aug 05 10:36:19.283485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:19.283485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ec7bdd0e-f0a6-4fb6-913b-d125c2ef4d95 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] Returning 404 to user: Volume 54f30ac3-7730-4f06-8fa0-d713460c16be could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:19.283485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ec7bdd0e-f0a6-4fb6-913b-d125c2ef4d95 tempest-VolumesSnapshotsTestJSON-1428630234 tempest-VolumesSnapshotsTestJSON-1428630234-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/54f30ac3-7730-4f06-8fa0-d713460c16be" status: 404 len: 109 microversion: 2.1 time: 0.036518 Aug 05 10:36:19.283485 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 557/1087] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 10:36:19 2022] GET /compute/v2.1/os-volumes/54f30ac3-7730-4f06-8fa0-d713460c16be => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:36:19.683297 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-df2d8bdb-f105-45f2-918a-f389550a8cb4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:19.687802 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-df2d8bdb-f105-45f2-918a-f389550a8cb4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:19.695289 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-df2d8bdb-f105-45f2-918a-f389550a8cb4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:19.695825 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-df2d8bdb-f105-45f2-918a-f389550a8cb4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:19.696333 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-df2d8bdb-f105-45f2-918a-f389550a8cb4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:19.697084 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-df2d8bdb-f105-45f2-918a-f389550a8cb4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:19.697570 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-df2d8bdb-f105-45f2-918a-f389550a8cb4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:19.697988 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-df2d8bdb-f105-45f2-918a-f389550a8cb4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:19.728939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-df2d8bdb-f105-45f2-918a-f389550a8cb4 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050828 Aug 05 10:36:19.729690 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 531/1088] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 5 10:36:19 2022] GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 10:36:19.797703 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5f06b220-91df-4373-ab0b-a8133bf9b6bd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:19.798440 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5f06b220-91df-4373-ab0b-a8133bf9b6bd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:19.806019 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5f06b220-91df-4373-ab0b-a8133bf9b6bd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:19.806492 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5f06b220-91df-4373-ab0b-a8133bf9b6bd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:19.806942 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5f06b220-91df-4373-ab0b-a8133bf9b6bd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:19.807630 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5f06b220-91df-4373-ab0b-a8133bf9b6bd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:19.808078 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5f06b220-91df-4373-ab0b-a8133bf9b6bd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:19.808492 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5f06b220-91df-4373-ab0b-a8133bf9b6bd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:19.834761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5f06b220-91df-4373-ab0b-a8133bf9b6bd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 10:36:19.914615 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5f06b220-91df-4373-ab0b-a8133bf9b6bd tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1" status: 204 len: 0 microversion: 2.1 time: 0.120605 Aug 05 10:36:19.915104 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 558/1089] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:36:19 2022] DELETE /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:36:19.924607 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ff017cda-0fbe-4bd4-a868-17affa9fd033 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:19.925213 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-ff017cda-0fbe-4bd4-a868-17affa9fd033 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:19.931288 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ff017cda-0fbe-4bd4-a868-17affa9fd033 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:19.931765 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ff017cda-0fbe-4bd4-a868-17affa9fd033 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:19.932191 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ff017cda-0fbe-4bd4-a868-17affa9fd033 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:19.932930 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ff017cda-0fbe-4bd4-a868-17affa9fd033 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:19.933371 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ff017cda-0fbe-4bd4-a868-17affa9fd033 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:19.933786 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ff017cda-0fbe-4bd4-a868-17affa9fd033 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:20.077417 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ff017cda-0fbe-4bd4-a868-17affa9fd033 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:36:20.085661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ff017cda-0fbe-4bd4-a868-17affa9fd033 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1" status: 200 len: 1682 microversion: 2.1 time: 0.165097 Aug 05 10:36:20.086325 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 532/1090] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:36:19 2022] GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:36:21.108679 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-70a40a2d-39b7-456b-8322-e48685ed8e99 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:21.109493 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-70a40a2d-39b7-456b-8322-e48685ed8e99 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:21.116325 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70a40a2d-39b7-456b-8322-e48685ed8e99 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:21.116811 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70a40a2d-39b7-456b-8322-e48685ed8e99 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:21.117240 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70a40a2d-39b7-456b-8322-e48685ed8e99 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:21.117929 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70a40a2d-39b7-456b-8322-e48685ed8e99 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:21.118498 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70a40a2d-39b7-456b-8322-e48685ed8e99 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:21.118929 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70a40a2d-39b7-456b-8322-e48685ed8e99 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:21.258608 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-70a40a2d-39b7-456b-8322-e48685ed8e99 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:36:21.267180 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-70a40a2d-39b7-456b-8322-e48685ed8e99 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1" status: 200 len: 1682 microversion: 2.1 time: 0.162876 Aug 05 10:36:21.267753 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 559/1091] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:36:21 2022] GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:36:22.289154 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-8b1bb34c-3c06-497b-89a2-3a2c203b743d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:22.289844 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-8b1bb34c-3c06-497b-89a2-3a2c203b743d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:22.297951 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8b1bb34c-3c06-497b-89a2-3a2c203b743d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:22.298474 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8b1bb34c-3c06-497b-89a2-3a2c203b743d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:22.299229 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8b1bb34c-3c06-497b-89a2-3a2c203b743d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:22.300146 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8b1bb34c-3c06-497b-89a2-3a2c203b743d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:22.300771 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8b1bb34c-3c06-497b-89a2-3a2c203b743d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:22.301197 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8b1bb34c-3c06-497b-89a2-3a2c203b743d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:22.539058 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-8b1bb34c-3c06-497b-89a2-3a2c203b743d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706dbfa719c04fd0a3704ebd7eb812cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c79a0604e49f49123980f0e9af63a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:36:22.549242 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-8b1bb34c-3c06-497b-89a2-3a2c203b743d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1" status: 200 len: 1682 microversion: 2.1 time: 0.264303 Aug 05 10:36:22.549772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 533/1092] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:36:22 2022] GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 => generated 1682 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:36:22.860138 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-906bf4d6-80d7-4b25-abb5-6b3e0fd1fa86 req-a74188d0-5d39-4a36-95e0-ab5f31939cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b2fb523-10a3-4ff3-aa94-096ec83f9cf1", "name": "network-vif-deleted", "tag": "092f9921-f266-483c-98f8-55c25728bae5"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:36:22.872824 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-906bf4d6-80d7-4b25-abb5-6b3e0fd1fa86 req-a74188d0-5d39-4a36-95e0-ab5f31939cf3 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:22.873419 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-906bf4d6-80d7-4b25-abb5-6b3e0fd1fa86 req-a74188d0-5d39-4a36-95e0-ab5f31939cf3 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:22.873860 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-906bf4d6-80d7-4b25-abb5-6b3e0fd1fa86 req-a74188d0-5d39-4a36-95e0-ab5f31939cf3 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:22.886020 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-906bf4d6-80d7-4b25-abb5-6b3e0fd1fa86 req-a74188d0-5d39-4a36-95e0-ab5f31939cf3 service nova] Creating event network-vif-deleted:092f9921-f266-483c-98f8-55c25728bae5 for instance 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 on hv-cinder-81558 Aug 05 10:36:22.898332 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-906bf4d6-80d7-4b25-abb5-6b3e0fd1fa86 req-a74188d0-5d39-4a36-95e0-ab5f31939cf3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037327 Aug 05 10:36:22.899306 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 560/1093] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:36:23.510665 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 10:36:23.511291 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Fri Aug 5 10:36:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 10:36:23.570451 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-dcbf713c-0761-4e9f-9ea9-f54c4cf09f6d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:23.571124 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-dcbf713c-0761-4e9f-9ea9-f54c4cf09f6d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:23.578305 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dcbf713c-0761-4e9f-9ea9-f54c4cf09f6d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:23.578794 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dcbf713c-0761-4e9f-9ea9-f54c4cf09f6d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:23.579253 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dcbf713c-0761-4e9f-9ea9-f54c4cf09f6d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:23.579996 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dcbf713c-0761-4e9f-9ea9-f54c4cf09f6d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:23.580455 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dcbf713c-0761-4e9f-9ea9-f54c4cf09f6d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:23.580884 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-dcbf713c-0761-4e9f-9ea9-f54c4cf09f6d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:23.595375 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-dcbf713c-0761-4e9f-9ea9-f54c4cf09f6d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] HTTP exception thrown: Instance 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 could not be found. Aug 05 10:36:23.596848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-dcbf713c-0761-4e9f-9ea9-f54c4cf09f6d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Request method failure captured: Aug 05 10:36:23.596848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 HTTP/1.1 Aug 05 10:36:23.596848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:36:23.596848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:36:23.596848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:36:23.596848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:36:23.596848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:36:23.596848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:36:23.596848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:36:23.596848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:23.596848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PBEs4GBOTlzHHz3GlVMvlqYVRTPVr6yfrGm0EGFVS5M35LAWkuYfM80ilZKBHnEJ38Pfkbr8nmaDnAJrpi-BzlSuGmVoFSK8TlIqOxf92-vzFhtlF5ILOctbBpl6iN-xfLgYYmkabgjeYJKmgu_f_koSkZUI4fIkuVQ5_PFB3z056g Aug 05 10:36:23.596848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:36:23.596848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:36:23.596848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:36:23.596848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:36:23.596848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:36:23.596848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:36:23.596848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:36:23.596848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:23.596848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:36:23.596848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:36:23.598556 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_588c79a0604e49f49123980f0e9af63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}] Aug 05 10:36:23.598556 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:23.598556 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:36:23.598556 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:23.598556 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:36:23.598556 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:36:23.598556 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:36:23.598556 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: 706dbfa719c04fd0a3704ebd7eb812cd Aug 05 10:36:23.598556 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:36:23.598556 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: > Aug 05 10:36:23.598556 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Instance 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 could not be found. Aug 05 10:36:23.598556 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'id': '4b2fb523-10a3-4ff3-aa94-096ec83f9cf1'} Aug 05 10:36:23.599646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:23.599646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:23.599646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:36:23.599646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:36:23.599646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:36:23.599646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:36:23.599646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:36:23.599646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:36:23.599646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:36:23.599646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:36:23.599646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 could not be found. Aug 05 10:36:23.599646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:23.599646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:23.599646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:23.599646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:23.599646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:23.599646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:23.599646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:23.599646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:23.599646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:23.601194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:23.601194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:36:23.601194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:36:23.601194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:36:23.601194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:36:23.601194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:36:23.601194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:23.601194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 could not be found. Aug 05 10:36:23.601194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:23.601194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:23.601194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:23.601194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:23.601194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:23.601194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:23.601194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:23.601194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:23.601194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 could not be found. Aug 05 10:36:23.601194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:23.602376 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-dcbf713c-0761-4e9f-9ea9-f54c4cf09f6d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Returning 404 to user: Instance 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:23.602376 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-dcbf713c-0761-4e9f-9ea9-f54c4cf09f6d tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1" status: 404 len: 111 microversion: 2.1 time: 0.032038 Aug 05 10:36:23.602376 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 534/1094] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:36:23 2022] GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:36:23.609140 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2cf4614e-a0b1-4fa5-8fa6-3c70177890e0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '.version_select at 0x7f73276cb310>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:23.635393 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2cf4614e-a0b1-4fa5-8fa6-3c70177890e0 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-916321340" status: 202 len: 0 microversion: 2.1 time: 0.031367 Aug 05 10:36:23.635962 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 561/1095] 10.222.0.40 () {58 vars in 1218 bytes} [Fri Aug 5 10:36:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-916321340 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:36:25.448834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b9533fbb-a0cc-4e0b-a549-593d577812d5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:25.449370 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b9533fbb-a0cc-4e0b-a549-593d577812d5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:25.456120 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b9533fbb-a0cc-4e0b-a549-593d577812d5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:25.456813 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b9533fbb-a0cc-4e0b-a549-593d577812d5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:25.457291 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b9533fbb-a0cc-4e0b-a549-593d577812d5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:25.458041 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b9533fbb-a0cc-4e0b-a549-593d577812d5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:25.458498 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b9533fbb-a0cc-4e0b-a549-593d577812d5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:25.458944 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b9533fbb-a0cc-4e0b-a549-593d577812d5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:25.474486 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-b9533fbb-a0cc-4e0b-a549-593d577812d5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] HTTP exception thrown: Instance 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 could not be found. Aug 05 10:36:25.476311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b9533fbb-a0cc-4e0b-a549-593d577812d5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Request method failure captured: Aug 05 10:36:25.476311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: DELETE /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 HTTP/1.1 Aug 05 10:36:25.476311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:36:25.476311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:36:25.476311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:36:25.476311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:36:25.476311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:36:25.476311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:36:25.476311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:36:25.476311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:25.476311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PBEs4GBOTlzHHz3GlVMvlqYVRTPVr6yfrGm0EGFVS5M35LAWkuYfM80ilZKBHnEJ38Pfkbr8nmaDnAJrpi-BzlSuGmVoFSK8TlIqOxf92-vzFhtlF5ILOctbBpl6iN-xfLgYYmkabgjeYJKmgu_f_koSkZUI4fIkuVQ5_PFB3z056g Aug 05 10:36:25.476311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:36:25.476311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:36:25.476311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:36:25.476311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:36:25.476311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:36:25.476311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:36:25.476311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:36:25.476311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:25.476311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:36:25.476311 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:36:25.477878 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_588c79a0604e49f49123980f0e9af63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}] Aug 05 10:36:25.477878 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:25.477878 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:36:25.477878 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:25.477878 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:36:25.477878 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:36:25.477878 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:36:25.477878 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: 706dbfa719c04fd0a3704ebd7eb812cd Aug 05 10:36:25.477878 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:36:25.477878 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: > Aug 05 10:36:25.477878 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Instance 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 could not be found. Aug 05 10:36:25.477878 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'id': '4b2fb523-10a3-4ff3-aa94-096ec83f9cf1'} Aug 05 10:36:25.478772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:25.478772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:25.478772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:36:25.478772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:36:25.478772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:36:25.478772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:36:25.478772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:36:25.478772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:36:25.478772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:36:25.478772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:36:25.478772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 could not be found. Aug 05 10:36:25.478772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:25.478772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:25.478772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:25.478772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:25.478772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:25.478772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:25.478772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:25.478772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:25.478772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:25.480262 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:25.480262 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 10:36:25.480262 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 10:36:25.480262 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 10:36:25.480262 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 10:36:25.480262 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:36:25.480262 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:36:25.480262 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:36:25.480262 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:25.480262 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 could not be found. Aug 05 10:36:25.480262 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:25.480262 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:25.480262 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:25.480262 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:25.480262 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:25.480262 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:25.480262 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:25.480262 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:25.480262 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 could not be found. Aug 05 10:36:25.480262 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:25.482456 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b9533fbb-a0cc-4e0b-a549-593d577812d5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Returning 404 to user: Instance 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:25.483334 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b9533fbb-a0cc-4e0b-a549-593d577812d5 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1" status: 404 len: 111 microversion: 2.1 time: 0.038568 Aug 05 10:36:25.483901 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 535/1096] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:36:25 2022] DELETE /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:36:25.492031 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-47054e52-b6bb-4703-bf79-3d237ed10a95 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:25.492866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-47054e52-b6bb-4703-bf79-3d237ed10a95 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:25.501086 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47054e52-b6bb-4703-bf79-3d237ed10a95 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:25.501643 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47054e52-b6bb-4703-bf79-3d237ed10a95 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:25.502145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47054e52-b6bb-4703-bf79-3d237ed10a95 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:25.502948 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47054e52-b6bb-4703-bf79-3d237ed10a95 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:25.503504 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47054e52-b6bb-4703-bf79-3d237ed10a95 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:25.503988 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47054e52-b6bb-4703-bf79-3d237ed10a95 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:25.518547 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-47054e52-b6bb-4703-bf79-3d237ed10a95 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] HTTP exception thrown: Instance 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 could not be found. Aug 05 10:36:25.520330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-47054e52-b6bb-4703-bf79-3d237ed10a95 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Request method failure captured: Aug 05 10:36:25.520330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 HTTP/1.1 Aug 05 10:36:25.520330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:36:25.520330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:36:25.520330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:36:25.520330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:36:25.520330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:36:25.520330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:36:25.520330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:36:25.520330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:25.520330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PBEs4GBOTlzHHz3GlVMvlqYVRTPVr6yfrGm0EGFVS5M35LAWkuYfM80ilZKBHnEJ38Pfkbr8nmaDnAJrpi-BzlSuGmVoFSK8TlIqOxf92-vzFhtlF5ILOctbBpl6iN-xfLgYYmkabgjeYJKmgu_f_koSkZUI4fIkuVQ5_PFB3z056g Aug 05 10:36:25.520330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:36:25.520330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:36:25.520330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:36:25.520330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:36:25.520330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:36:25.520330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:36:25.520330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:36:25.520330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:25.520330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:36:25.520330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:36:25.521909 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_588c79a0604e49f49123980f0e9af63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}] Aug 05 10:36:25.521909 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:25.521909 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:36:25.521909 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:25.521909 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:36:25.521909 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:36:25.521909 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:36:25.521909 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: 706dbfa719c04fd0a3704ebd7eb812cd Aug 05 10:36:25.521909 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:36:25.521909 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:36:25.521909 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Instance 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 could not be found. Aug 05 10:36:25.521909 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': '4b2fb523-10a3-4ff3-aa94-096ec83f9cf1'} Aug 05 10:36:25.522813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:25.522813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:25.522813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:36:25.522813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:36:25.522813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:36:25.522813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:36:25.522813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:36:25.522813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:36:25.522813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:36:25.522813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:36:25.522813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 could not be found. Aug 05 10:36:25.522813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:25.522813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:25.522813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:25.522813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:25.522813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:25.522813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:25.522813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:25.522813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:25.522813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:25.524490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:25.524490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:36:25.524490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:36:25.524490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:36:25.524490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:36:25.524490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:36:25.524490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:25.524490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 could not be found. Aug 05 10:36:25.524490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:25.524490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:25.524490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:25.524490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:25.524490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:25.524490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:25.524490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:25.524490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:25.524490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 could not be found. Aug 05 10:36:25.524490 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:25.525816 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-47054e52-b6bb-4703-bf79-3d237ed10a95 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Returning 404 to user: Instance 4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:25.525816 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-47054e52-b6bb-4703-bf79-3d237ed10a95 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1" status: 404 len: 111 microversion: 2.1 time: 0.033604 Aug 05 10:36:25.525979 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 562/1097] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:36:25 2022] GET /compute/v2.1/servers/4b2fb523-10a3-4ff3-aa94-096ec83f9cf1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 10:36:26.666977 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-8826fcb6-1655-4124-a5bc-1ba25e7985b2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:26.667510 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-8826fcb6-1655-4124-a5bc-1ba25e7985b2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:26.675031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8826fcb6-1655-4124-a5bc-1ba25e7985b2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:26.675661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8826fcb6-1655-4124-a5bc-1ba25e7985b2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:26.676083 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8826fcb6-1655-4124-a5bc-1ba25e7985b2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:26.676800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8826fcb6-1655-4124-a5bc-1ba25e7985b2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:26.677257 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8826fcb6-1655-4124-a5bc-1ba25e7985b2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:26.677678 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8826fcb6-1655-4124-a5bc-1ba25e7985b2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:26.692341 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-8826fcb6-1655-4124-a5bc-1ba25e7985b2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] HTTP exception thrown: Instance a2ddd5d5-3966-4be6-a170-983dfa513c70 could not be found. Aug 05 10:36:26.693905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-8826fcb6-1655-4124-a5bc-1ba25e7985b2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Request method failure captured: Aug 05 10:36:26.693905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: DELETE /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70 HTTP/1.1 Aug 05 10:36:26.693905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:36:26.693905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:36:26.693905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:36:26.693905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:36:26.693905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:36:26.693905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:36:26.693905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:36:26.693905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:26.693905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PBEs4GBOTlzHHz3GlVMvlqYVRTPVr6yfrGm0EGFVS5M35LAWkuYfM80ilZKBHnEJ38Pfkbr8nmaDnAJrpi-BzlSuGmVoFSK8TlIqOxf92-vzFhtlF5ILOctbBpl6iN-xfLgYYmkabgjeYJKmgu_f_koSkZUI4fIkuVQ5_PFB3z056g Aug 05 10:36:26.693905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:36:26.693905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:36:26.693905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:36:26.693905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:36:26.693905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:36:26.693905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:36:26.693905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:36:26.693905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:26.693905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:36:26.693905 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:36:26.695274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_588c79a0604e49f49123980f0e9af63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}] Aug 05 10:36:26.695274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:26.695274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:36:26.695274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:26.695274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:36:26.695274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:36:26.695274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:36:26.695274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: 706dbfa719c04fd0a3704ebd7eb812cd Aug 05 10:36:26.695274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:36:26.695274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: > Aug 05 10:36:26.695274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Instance a2ddd5d5-3966-4be6-a170-983dfa513c70 could not be found. Aug 05 10:36:26.695274 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'id': 'a2ddd5d5-3966-4be6-a170-983dfa513c70'} Aug 05 10:36:26.696142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:26.696142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:26.696142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:36:26.696142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:36:26.696142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:36:26.696142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:36:26.696142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:36:26.696142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:36:26.696142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:36:26.696142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:36:26.696142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2ddd5d5-3966-4be6-a170-983dfa513c70 could not be found. Aug 05 10:36:26.696142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:26.696142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:26.696142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:26.696142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:26.696142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:26.696142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:26.696142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:26.696142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:26.696142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:26.699045 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:26.699045 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 10:36:26.699045 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 10:36:26.699045 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 10:36:26.699045 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 10:36:26.699045 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:36:26.699045 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:36:26.699045 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:36:26.699045 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:26.699045 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2ddd5d5-3966-4be6-a170-983dfa513c70 could not be found. Aug 05 10:36:26.699045 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:26.699045 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:26.699045 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:26.699045 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:26.699045 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:26.699045 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:26.699045 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:26.699045 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:26.699045 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2ddd5d5-3966-4be6-a170-983dfa513c70 could not be found. Aug 05 10:36:26.699045 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:26.701745 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-8826fcb6-1655-4124-a5bc-1ba25e7985b2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Returning 404 to user: Instance a2ddd5d5-3966-4be6-a170-983dfa513c70 could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:26.701745 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-8826fcb6-1655-4124-a5bc-1ba25e7985b2 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70" status: 404 len: 111 microversion: 2.1 time: 0.033207 Aug 05 10:36:26.701745 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 536/1098] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:36:26 2022] DELETE /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:36:26.704146 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7c10a887-9774-49a3-ad84-272acbf92fdc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:26.704762 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7c10a887-9774-49a3-ad84-272acbf92fdc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: a2ddd5d5-3966-4be6-a170-983dfa513c70] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:26.712591 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c10a887-9774-49a3-ad84-272acbf92fdc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:26.713410 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c10a887-9774-49a3-ad84-272acbf92fdc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:26.713866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c10a887-9774-49a3-ad84-272acbf92fdc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:26.714647 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c10a887-9774-49a3-ad84-272acbf92fdc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:26.715288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c10a887-9774-49a3-ad84-272acbf92fdc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:26.715735 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c10a887-9774-49a3-ad84-272acbf92fdc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:26.730212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-7c10a887-9774-49a3-ad84-272acbf92fdc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] HTTP exception thrown: Instance a2ddd5d5-3966-4be6-a170-983dfa513c70 could not be found. Aug 05 10:36:26.732119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7c10a887-9774-49a3-ad84-272acbf92fdc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Request method failure captured: Aug 05 10:36:26.732119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70 HTTP/1.1 Aug 05 10:36:26.732119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:36:26.732119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:36:26.732119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:36:26.732119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:36:26.732119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:36:26.732119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:36:26.732119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:36:26.732119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:26.732119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PBEs4GBOTlzHHz3GlVMvlqYVRTPVr6yfrGm0EGFVS5M35LAWkuYfM80ilZKBHnEJ38Pfkbr8nmaDnAJrpi-BzlSuGmVoFSK8TlIqOxf92-vzFhtlF5ILOctbBpl6iN-xfLgYYmkabgjeYJKmgu_f_koSkZUI4fIkuVQ5_PFB3z056g Aug 05 10:36:26.732119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:36:26.732119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:36:26.732119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:36:26.732119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:36:26.732119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:36:26.732119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:36:26.732119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:36:26.732119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:26.732119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:36:26.732119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:36:26.733801 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_588c79a0604e49f49123980f0e9af63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}] Aug 05 10:36:26.733801 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:26.733801 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:36:26.733801 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:26.733801 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:36:26.733801 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:36:26.733801 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:36:26.733801 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: 706dbfa719c04fd0a3704ebd7eb812cd Aug 05 10:36:26.733801 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:36:26.733801 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:36:26.733801 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Instance a2ddd5d5-3966-4be6-a170-983dfa513c70 could not be found. Aug 05 10:36:26.733801 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': 'a2ddd5d5-3966-4be6-a170-983dfa513c70'} Aug 05 10:36:26.734686 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:26.734686 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:26.734686 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:36:26.734686 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:36:26.734686 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:36:26.734686 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:36:26.734686 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:36:26.734686 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:36:26.734686 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:36:26.734686 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:36:26.734686 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2ddd5d5-3966-4be6-a170-983dfa513c70 could not be found. Aug 05 10:36:26.734686 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:26.734686 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:26.734686 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:26.734686 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:26.734686 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:26.734686 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:26.734686 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:26.734686 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:26.734686 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:26.736126 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:26.736126 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:36:26.736126 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:36:26.736126 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:36:26.736126 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:36:26.736126 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:36:26.736126 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:26.736126 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2ddd5d5-3966-4be6-a170-983dfa513c70 could not be found. Aug 05 10:36:26.736126 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:26.736126 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:26.736126 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:26.736126 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:26.736126 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:26.736126 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:26.736126 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:26.736126 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:26.736126 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2ddd5d5-3966-4be6-a170-983dfa513c70 could not be found. Aug 05 10:36:26.736126 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:26.737390 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7c10a887-9774-49a3-ad84-272acbf92fdc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Returning 404 to user: Instance a2ddd5d5-3966-4be6-a170-983dfa513c70 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:26.737390 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7c10a887-9774-49a3-ad84-272acbf92fdc tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70" status: 404 len: 111 microversion: 2.1 time: 0.033222 Aug 05 10:36:26.737390 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 563/1099] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:36:26 2022] GET /compute/v2.1/servers/a2ddd5d5-3966-4be6-a170-983dfa513c70 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:36:26.742403 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f8ac2c9e-3dc3-4aad-8972-e1365d133ece tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:26.742921 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f8ac2c9e-3dc3-4aad-8972-e1365d133ece tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:26.749488 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f8ac2c9e-3dc3-4aad-8972-e1365d133ece tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:26.749976 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f8ac2c9e-3dc3-4aad-8972-e1365d133ece tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:26.750414 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f8ac2c9e-3dc3-4aad-8972-e1365d133ece tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:26.751261 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f8ac2c9e-3dc3-4aad-8972-e1365d133ece tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:26.751713 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f8ac2c9e-3dc3-4aad-8972-e1365d133ece tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:26.752135 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f8ac2c9e-3dc3-4aad-8972-e1365d133ece tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:26.767343 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-f8ac2c9e-3dc3-4aad-8972-e1365d133ece tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] HTTP exception thrown: Instance 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 could not be found. Aug 05 10:36:26.769129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f8ac2c9e-3dc3-4aad-8972-e1365d133ece tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Request method failure captured: Aug 05 10:36:26.769129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: DELETE /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 HTTP/1.1 Aug 05 10:36:26.769129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:36:26.769129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:36:26.769129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:36:26.769129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:36:26.769129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:36:26.769129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:36:26.769129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:36:26.769129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:26.769129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PBEs4GBOTlzHHz3GlVMvlqYVRTPVr6yfrGm0EGFVS5M35LAWkuYfM80ilZKBHnEJ38Pfkbr8nmaDnAJrpi-BzlSuGmVoFSK8TlIqOxf92-vzFhtlF5ILOctbBpl6iN-xfLgYYmkabgjeYJKmgu_f_koSkZUI4fIkuVQ5_PFB3z056g Aug 05 10:36:26.769129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:36:26.769129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:36:26.769129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:36:26.769129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:36:26.769129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:36:26.769129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:36:26.769129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:36:26.769129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:26.769129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:36:26.769129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:36:26.770669 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_588c79a0604e49f49123980f0e9af63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}] Aug 05 10:36:26.770669 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:26.770669 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:36:26.770669 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:26.770669 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:36:26.770669 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:36:26.770669 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:36:26.770669 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: 706dbfa719c04fd0a3704ebd7eb812cd Aug 05 10:36:26.770669 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:36:26.770669 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: > Aug 05 10:36:26.770669 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Instance 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 could not be found. Aug 05 10:36:26.770669 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'id': '7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3'} Aug 05 10:36:26.771590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:26.771590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:26.771590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:36:26.771590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:36:26.771590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:36:26.771590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:36:26.771590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:36:26.771590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:36:26.771590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:36:26.771590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:36:26.771590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 could not be found. Aug 05 10:36:26.771590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:26.771590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:26.771590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:26.771590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:26.771590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:26.771590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:26.771590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:26.771590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:26.771590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:26.773059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:26.773059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 10:36:26.773059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 10:36:26.773059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 10:36:26.773059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 10:36:26.773059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:36:26.773059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:36:26.773059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:36:26.773059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:26.773059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 could not be found. Aug 05 10:36:26.773059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:26.773059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:26.773059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:26.773059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:26.773059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:26.773059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:26.773059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:26.773059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:26.773059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 could not be found. Aug 05 10:36:26.773059 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:26.775228 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f8ac2c9e-3dc3-4aad-8972-e1365d133ece tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Returning 404 to user: Instance 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:26.776080 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f8ac2c9e-3dc3-4aad-8972-e1365d133ece tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 404 len: 111 microversion: 2.1 time: 0.037661 Aug 05 10:36:26.776632 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 537/1100] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:36:26 2022] DELETE /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:36:26.784691 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-33d698ab-599c-47db-99de-3fb447441a1f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:26.785294 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-33d698ab-599c-47db-99de-3fb447441a1f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:26.791383 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33d698ab-599c-47db-99de-3fb447441a1f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:26.791861 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33d698ab-599c-47db-99de-3fb447441a1f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:26.792288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33d698ab-599c-47db-99de-3fb447441a1f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:26.793052 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33d698ab-599c-47db-99de-3fb447441a1f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:26.793504 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33d698ab-599c-47db-99de-3fb447441a1f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:26.793925 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33d698ab-599c-47db-99de-3fb447441a1f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:26.808937 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-33d698ab-599c-47db-99de-3fb447441a1f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] HTTP exception thrown: Instance 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 could not be found. Aug 05 10:36:26.810456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-33d698ab-599c-47db-99de-3fb447441a1f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Request method failure captured: Aug 05 10:36:26.810456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 HTTP/1.1 Aug 05 10:36:26.810456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:36:26.810456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:36:26.810456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:36:26.810456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:36:26.810456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:36:26.810456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:36:26.810456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:36:26.810456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:26.810456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PBEs4GBOTlzHHz3GlVMvlqYVRTPVr6yfrGm0EGFVS5M35LAWkuYfM80ilZKBHnEJ38Pfkbr8nmaDnAJrpi-BzlSuGmVoFSK8TlIqOxf92-vzFhtlF5ILOctbBpl6iN-xfLgYYmkabgjeYJKmgu_f_koSkZUI4fIkuVQ5_PFB3z056g Aug 05 10:36:26.810456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:36:26.810456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:36:26.810456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:36:26.810456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:36:26.810456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:36:26.810456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:36:26.810456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:36:26.810456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:26.810456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:36:26.810456 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:36:26.812127 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_588c79a0604e49f49123980f0e9af63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}] Aug 05 10:36:26.812127 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:26.812127 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:36:26.812127 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:26.812127 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:36:26.812127 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:36:26.812127 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:36:26.812127 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: 706dbfa719c04fd0a3704ebd7eb812cd Aug 05 10:36:26.812127 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:36:26.812127 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:36:26.812127 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Instance 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 could not be found. Aug 05 10:36:26.812127 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': '7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3'} Aug 05 10:36:26.813467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:26.813467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:26.813467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:36:26.813467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:36:26.813467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:36:26.813467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:36:26.813467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:36:26.813467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:36:26.813467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:36:26.813467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:36:26.813467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 could not be found. Aug 05 10:36:26.813467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:26.813467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:26.813467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:26.813467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:26.813467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:26.813467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:26.813467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:26.813467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:26.813467 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:26.814804 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:26.814804 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:36:26.814804 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:36:26.814804 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:36:26.814804 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:36:26.814804 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:36:26.814804 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:26.814804 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 could not be found. Aug 05 10:36:26.814804 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:26.814804 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:26.814804 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:26.814804 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:26.814804 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:26.814804 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:26.814804 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:26.814804 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:26.814804 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 could not be found. Aug 05 10:36:26.814804 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:26.816072 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-33d698ab-599c-47db-99de-3fb447441a1f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Returning 404 to user: Instance 7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:26.816072 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-33d698ab-599c-47db-99de-3fb447441a1f tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3" status: 404 len: 111 microversion: 2.1 time: 0.031088 Aug 05 10:36:26.816072 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 564/1101] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:36:26 2022] GET /compute/v2.1/servers/7086d8a1-2ee2-4771-a8f2-cfbdd6dbe5f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:36:27.955191 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-17c133bd-6af4-4e20-b71d-2aec157a10f1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:27.955737 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-17c133bd-6af4-4e20-b71d-2aec157a10f1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:27.962522 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-17c133bd-6af4-4e20-b71d-2aec157a10f1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:27.963036 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-17c133bd-6af4-4e20-b71d-2aec157a10f1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:27.963448 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-17c133bd-6af4-4e20-b71d-2aec157a10f1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:27.964143 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-17c133bd-6af4-4e20-b71d-2aec157a10f1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:27.964595 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-17c133bd-6af4-4e20-b71d-2aec157a10f1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:27.965025 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-17c133bd-6af4-4e20-b71d-2aec157a10f1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:27.978934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-17c133bd-6af4-4e20-b71d-2aec157a10f1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] HTTP exception thrown: Instance cfcbf025-92b9-4b98-8819-7f9fb41dce79 could not be found. Aug 05 10:36:27.981016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-17c133bd-6af4-4e20-b71d-2aec157a10f1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Request method failure captured: Aug 05 10:36:27.981016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: DELETE /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 HTTP/1.1 Aug 05 10:36:27.981016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:36:27.981016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:36:27.981016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:36:27.981016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:36:27.981016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:36:27.981016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:36:27.981016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:36:27.981016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:27.981016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PBEs4GBOTlzHHz3GlVMvlqYVRTPVr6yfrGm0EGFVS5M35LAWkuYfM80ilZKBHnEJ38Pfkbr8nmaDnAJrpi-BzlSuGmVoFSK8TlIqOxf92-vzFhtlF5ILOctbBpl6iN-xfLgYYmkabgjeYJKmgu_f_koSkZUI4fIkuVQ5_PFB3z056g Aug 05 10:36:27.981016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:36:27.981016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:36:27.981016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:36:27.981016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:36:27.981016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:36:27.981016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:36:27.981016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:36:27.981016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:27.981016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:36:27.981016 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:36:27.982430 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_588c79a0604e49f49123980f0e9af63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}] Aug 05 10:36:27.982430 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:27.982430 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:36:27.982430 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:27.982430 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:36:27.982430 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:36:27.982430 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:36:27.982430 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: 706dbfa719c04fd0a3704ebd7eb812cd Aug 05 10:36:27.982430 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:36:27.982430 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: > Aug 05 10:36:27.982430 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Instance cfcbf025-92b9-4b98-8819-7f9fb41dce79 could not be found. Aug 05 10:36:27.982430 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'id': 'cfcbf025-92b9-4b98-8819-7f9fb41dce79'} Aug 05 10:36:27.983299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:27.983299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:27.983299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:36:27.983299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:36:27.983299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:36:27.983299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:36:27.983299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:36:27.983299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:36:27.983299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:36:27.983299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:36:27.983299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfcbf025-92b9-4b98-8819-7f9fb41dce79 could not be found. Aug 05 10:36:27.983299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:27.983299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:27.983299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:27.983299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:27.983299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:27.983299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:27.983299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:27.983299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:27.983299 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:27.984531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:27.984531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 10:36:27.984531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 10:36:27.984531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 10:36:27.984531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 10:36:27.984531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:36:27.984531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:36:27.984531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:36:27.984531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:27.984531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfcbf025-92b9-4b98-8819-7f9fb41dce79 could not be found. Aug 05 10:36:27.984531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:27.984531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:27.984531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:27.984531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:27.984531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:27.984531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:27.984531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:27.984531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:27.984531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfcbf025-92b9-4b98-8819-7f9fb41dce79 could not be found. Aug 05 10:36:27.984531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:27.986782 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-17c133bd-6af4-4e20-b71d-2aec157a10f1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Returning 404 to user: Instance cfcbf025-92b9-4b98-8819-7f9fb41dce79 could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:27.986782 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-17c133bd-6af4-4e20-b71d-2aec157a10f1 tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 404 len: 111 microversion: 2.1 time: 0.031606 Aug 05 10:36:27.986782 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 538/1102] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:36:27 2022] DELETE /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:36:27.990682 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-23c94326-6040-440a-89d7-808f1b33569a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:27.991314 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-23c94326-6040-440a-89d7-808f1b33569a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] [instance: cfcbf025-92b9-4b98-8819-7f9fb41dce79] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:27.998312 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-23c94326-6040-440a-89d7-808f1b33569a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:27.998777 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-23c94326-6040-440a-89d7-808f1b33569a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:27.999241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-23c94326-6040-440a-89d7-808f1b33569a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:27.999933 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-23c94326-6040-440a-89d7-808f1b33569a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:28.000377 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-23c94326-6040-440a-89d7-808f1b33569a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:28.000777 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-23c94326-6040-440a-89d7-808f1b33569a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:28.017197 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-23c94326-6040-440a-89d7-808f1b33569a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] HTTP exception thrown: Instance cfcbf025-92b9-4b98-8819-7f9fb41dce79 could not be found. Aug 05 10:36:28.018709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-23c94326-6040-440a-89d7-808f1b33569a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Request method failure captured: Aug 05 10:36:28.018709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 HTTP/1.1 Aug 05 10:36:28.018709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:36:28.018709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:36:28.018709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:36:28.018709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:36:28.018709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:36:28.018709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:36:28.018709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:36:28.018709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:28.018709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PBEs4GBOTlzHHz3GlVMvlqYVRTPVr6yfrGm0EGFVS5M35LAWkuYfM80ilZKBHnEJ38Pfkbr8nmaDnAJrpi-BzlSuGmVoFSK8TlIqOxf92-vzFhtlF5ILOctbBpl6iN-xfLgYYmkabgjeYJKmgu_f_koSkZUI4fIkuVQ5_PFB3z056g Aug 05 10:36:28.018709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:36:28.018709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:36:28.018709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:36:28.018709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:36:28.018709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:36:28.018709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:36:28.018709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:36:28.018709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:28.018709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:36:28.018709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:36:28.020359 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_588c79a0604e49f49123980f0e9af63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/588c79a0604e49f49123980f0e9af63a"}]}] Aug 05 10:36:28.020359 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:28.020359 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 588c79a0604e49f49123980f0e9af63a Aug 05 10:36:28.020359 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-540415074 Aug 05 10:36:28.020359 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:36:28.020359 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:36:28.020359 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:36:28.020359 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: 706dbfa719c04fd0a3704ebd7eb812cd Aug 05 10:36:28.020359 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-540415074-project Aug 05 10:36:28.020359 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:36:28.020359 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Instance cfcbf025-92b9-4b98-8819-7f9fb41dce79 could not be found. Aug 05 10:36:28.020359 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': 'cfcbf025-92b9-4b98-8819-7f9fb41dce79'} Aug 05 10:36:28.021143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:28.021143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:28.021143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:36:28.021143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:36:28.021143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:36:28.021143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:36:28.021143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:36:28.021143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:36:28.021143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:36:28.021143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:36:28.021143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfcbf025-92b9-4b98-8819-7f9fb41dce79 could not be found. Aug 05 10:36:28.021143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:28.021143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:28.021143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:28.021143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:28.021143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:28.021143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:28.021143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:28.021143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:28.021143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:28.023288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:28.023288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:36:28.023288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:36:28.023288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:36:28.023288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:36:28.023288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:36:28.023288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:28.023288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfcbf025-92b9-4b98-8819-7f9fb41dce79 could not be found. Aug 05 10:36:28.023288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:28.023288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:28.023288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:28.023288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:28.023288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:28.023288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:28.023288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:28.023288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:28.023288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfcbf025-92b9-4b98-8819-7f9fb41dce79 could not be found. Aug 05 10:36:28.023288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:28.025007 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-23c94326-6040-440a-89d7-808f1b33569a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] Returning 404 to user: Instance cfcbf025-92b9-4b98-8819-7f9fb41dce79 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:28.025007 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-23c94326-6040-440a-89d7-808f1b33569a tempest-AttachVolumeNegativeTest-540415074 tempest-AttachVolumeNegativeTest-540415074-project] 10.222.0.40 "GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79" status: 404 len: 111 microversion: 2.1 time: 0.033294 Aug 05 10:36:28.025007 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 565/1103] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:36:27 2022] GET /compute/v2.1/servers/cfcbf025-92b9-4b98-8819-7f9fb41dce79 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:36:33.470510 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-70327e63-317b-4a5d-93c1-9af7a9b17581 tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] Action: 'create', calling method: .version_select at 0x7f732775adc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1173272724", "metadata": {"Type": "work"}}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:36:33.500031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-70327e63-317b-4a5d-93c1-9af7a9b17581 tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] Request method failure captured: Aug 05 10:36:33.500031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 10:36:33.500031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:36:33.500031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:36:33.500031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:36:33.500031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 122 Aug 05 10:36:33.500031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:36:33.500031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:36:33.500031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:36:33.500031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:33.500031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PKxGkLkAEh2wfK0HRtIDRljOh0LjqPNeaU4dBBs6WHOefflC9--8NnQ9_Zh9YL79fsFP3UUgkgL5f1YrzI_c-_lHbJgAwBy7VdL5S0t3DcCJlzLrhfRqEOeVK06YlzWsRYb6B0bwj9e0hh1_kq9GMHD2scx99eFwNEMvcIyMibyLHA Aug 05 10:36:33.500031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:36:33.500031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:36:33.500031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:36:33.500031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:36:33.500031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:36:33.500031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:36:33.500031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 47fca44a92454bb9a829a30e1afc1bd2 Aug 05 10:36:33.500031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-VolumesNegativeTest-2077654204 Aug 05 10:36:33.500031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:36:33.500031 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:36:33.501583 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_47fca44a92454bb9a829a30e1afc1bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/47fca44a92454bb9a829a30e1afc1bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47fca44a92454bb9a829a30e1afc1bd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47fca44a92454bb9a829a30e1afc1bd2"}]}] Aug 05 10:36:33.501583 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-VolumesNegativeTest-2077654204 Aug 05 10:36:33.501583 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 47fca44a92454bb9a829a30e1afc1bd2 Aug 05 10:36:33.501583 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-VolumesNegativeTest-2077654204 Aug 05 10:36:33.501583 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-VolumesNegativeTest-2077654204-project Aug 05 10:36:33.501583 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:36:33.501583 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:36:33.501583 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: 763f482ab8a34ae881d2e6101c202dac Aug 05 10:36:33.501583 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-VolumesNegativeTest-2077654204-project Aug 05 10:36:33.501583 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Aug 05 10:36:33.501583 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1173272724", "metadata": {"Type": "work"}}} Aug 05 10:36:33.501583 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: Aug 05 10:36:33.501583 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 10:36:33.503018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1173272724', 'metadata': {'Type': 'work'}}}} Aug 05 10:36:33.503018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:33.503018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:33.503018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 10:36:33.503018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 10:36:33.503018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 10:36:33.503018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise error Aug 05 10:36:33.503018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 05 10:36:33.503018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.503018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 05 10:36:33.503018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 10:36:33.503018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.503018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 10:36:33.503018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi '#$%' Aug 05 10:36:33.503018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.503018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:33.503018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.503018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:33.503018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:33.503018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:33.503018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:33.503018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:33.504955 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 10:36:33.504955 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 10:36:33.504955 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:33.504955 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:33.504955 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 10:36:33.504955 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 10:36:33.504955 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 10:36:33.504955 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 10:36:33.504955 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 10:36:33.504955 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 10:36:33.504955 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 10:36:33.504955 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.504955 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:33.504955 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.504955 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:33.504955 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:33.504955 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:33.504955 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 10:36:33.504955 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 10:36:33.506259 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 10:36:33.506259 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.506259 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-70327e63-317b-4a5d-93c1-9af7a9b17581 tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:33.506259 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-70327e63-317b-4a5d-93c1-9af7a9b17581 tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.151431 Aug 05 10:36:33.506259 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 539/1104] 10.222.0.40 () {60 vars in 1156 bytes} [Fri Aug 5 10:36:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 10:36:33.512879 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5cf0263b-55d6-424a-9906-69ef351354c1 tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] Action: 'create', calling method: .version_select at 0x7f732c0a0430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-869500059", "metadata": {"Type": "work"}}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:36:33.517986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5cf0263b-55d6-424a-9906-69ef351354c1 tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] Request method failure captured: Aug 05 10:36:33.517986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 10:36:33.517986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:36:33.517986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:36:33.517986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:36:33.517986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 119 Aug 05 10:36:33.517986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:36:33.517986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:36:33.517986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:36:33.517986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:33.517986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PKxGkLkAEh2wfK0HRtIDRljOh0LjqPNeaU4dBBs6WHOefflC9--8NnQ9_Zh9YL79fsFP3UUgkgL5f1YrzI_c-_lHbJgAwBy7VdL5S0t3DcCJlzLrhfRqEOeVK06YlzWsRYb6B0bwj9e0hh1_kq9GMHD2scx99eFwNEMvcIyMibyLHA Aug 05 10:36:33.517986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:36:33.517986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:36:33.517986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:36:33.517986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:36:33.517986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:36:33.517986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:36:33.517986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 47fca44a92454bb9a829a30e1afc1bd2 Aug 05 10:36:33.517986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesNegativeTest-2077654204 Aug 05 10:36:33.517986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:36:33.517986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:36:33.521043 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_47fca44a92454bb9a829a30e1afc1bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/47fca44a92454bb9a829a30e1afc1bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47fca44a92454bb9a829a30e1afc1bd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47fca44a92454bb9a829a30e1afc1bd2"}]}] Aug 05 10:36:33.521043 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesNegativeTest-2077654204 Aug 05 10:36:33.521043 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 47fca44a92454bb9a829a30e1afc1bd2 Aug 05 10:36:33.521043 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesNegativeTest-2077654204 Aug 05 10:36:33.521043 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesNegativeTest-2077654204-project Aug 05 10:36:33.521043 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:36:33.521043 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:36:33.521043 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: 763f482ab8a34ae881d2e6101c202dac Aug 05 10:36:33.521043 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesNegativeTest-2077654204-project Aug 05 10:36:33.521043 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Aug 05 10:36:33.521043 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-869500059", "metadata": {"Type": "work"}}} Aug 05 10:36:33.521043 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: Aug 05 10:36:33.521043 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 10:36:33.522634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-869500059', 'metadata': {'Type': 'work'}}}} Aug 05 10:36:33.522634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:33.522634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:33.522634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 10:36:33.522634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 10:36:33.522634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 10:36:33.522634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise error Aug 05 10:36:33.522634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 05 10:36:33.522634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.522634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 05 10:36:33.522634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 10:36:33.522634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.522634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 10:36:33.522634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi '0' Aug 05 10:36:33.522634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.522634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:33.522634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.522634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:33.522634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:33.522634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:33.522634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:33.522634 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:33.525178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 10:36:33.525178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 10:36:33.525178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:33.525178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:33.525178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 10:36:33.525178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 10:36:33.525178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 10:36:33.525178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 10:36:33.525178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 10:36:33.525178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 10:36:33.525178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 10:36:33.525178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.525178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:33.525178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.525178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:33.525178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:33.525178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:33.525178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 10:36:33.525178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 10:36:33.527269 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 10:36:33.527269 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.527269 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5cf0263b-55d6-424a-9906-69ef351354c1 tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:33.527269 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5cf0263b-55d6-424a-9906-69ef351354c1 tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010930 Aug 05 10:36:33.527269 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 566/1105] 10.222.0.40 () {60 vars in 1156 bytes} [Fri Aug 5 10:36:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 10:36:33.530732 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-97fd220e-a8e1-4fe3-af16-1a463c74b453 tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] Action: 'create', calling method: .version_select at 0x7f73274a4550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-184111501", "metadata": {"Type": "work"}}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:36:33.538024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-97fd220e-a8e1-4fe3-af16-1a463c74b453 tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] Request method failure captured: Aug 05 10:36:33.538024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 10:36:33.538024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:36:33.538024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:36:33.538024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:36:33.538024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 118 Aug 05 10:36:33.538024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:36:33.538024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:36:33.538024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:36:33.538024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:33.538024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PKxGkLkAEh2wfK0HRtIDRljOh0LjqPNeaU4dBBs6WHOefflC9--8NnQ9_Zh9YL79fsFP3UUgkgL5f1YrzI_c-_lHbJgAwBy7VdL5S0t3DcCJlzLrhfRqEOeVK06YlzWsRYb6B0bwj9e0hh1_kq9GMHD2scx99eFwNEMvcIyMibyLHA Aug 05 10:36:33.538024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:36:33.538024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:36:33.538024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:36:33.538024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:36:33.538024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:36:33.538024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:36:33.538024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 47fca44a92454bb9a829a30e1afc1bd2 Aug 05 10:36:33.538024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-VolumesNegativeTest-2077654204 Aug 05 10:36:33.538024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:36:33.538024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:36:33.540036 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_47fca44a92454bb9a829a30e1afc1bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/47fca44a92454bb9a829a30e1afc1bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47fca44a92454bb9a829a30e1afc1bd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47fca44a92454bb9a829a30e1afc1bd2"}]}] Aug 05 10:36:33.540036 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-VolumesNegativeTest-2077654204 Aug 05 10:36:33.540036 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 47fca44a92454bb9a829a30e1afc1bd2 Aug 05 10:36:33.540036 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-VolumesNegativeTest-2077654204 Aug 05 10:36:33.540036 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-VolumesNegativeTest-2077654204-project Aug 05 10:36:33.540036 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:36:33.540036 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:36:33.540036 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: 763f482ab8a34ae881d2e6101c202dac Aug 05 10:36:33.540036 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-VolumesNegativeTest-2077654204-project Aug 05 10:36:33.540036 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Aug 05 10:36:33.540036 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-184111501", "metadata": {"Type": "work"}}} Aug 05 10:36:33.540036 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: Aug 05 10:36:33.540036 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 10:36:33.540939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-184111501', 'metadata': {'Type': 'work'}}}} Aug 05 10:36:33.540939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:33.540939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:33.540939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 10:36:33.540939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 10:36:33.540939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 10:36:33.540939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise error Aug 05 10:36:33.540939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 05 10:36:33.540939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.540939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 05 10:36:33.540939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 10:36:33.540939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.540939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 10:36:33.540939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi '' Aug 05 10:36:33.540939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.540939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:33.540939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.540939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:33.540939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:33.540939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:33.540939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:33.540939 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:33.542586 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 10:36:33.542586 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 10:36:33.542586 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:33.542586 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:33.542586 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 10:36:33.542586 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 10:36:33.542586 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 10:36:33.542586 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 10:36:33.542586 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 10:36:33.542586 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 10:36:33.542586 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 10:36:33.542586 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.542586 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:33.542586 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.542586 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:33.542586 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:33.542586 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:33.542586 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 10:36:33.542586 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 10:36:33.543880 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 10:36:33.543880 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.543880 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-97fd220e-a8e1-4fe3-af16-1a463c74b453 tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:33.543880 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-97fd220e-a8e1-4fe3-af16-1a463c74b453 tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013767 Aug 05 10:36:33.543880 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 540/1106] 10.222.0.40 () {60 vars in 1156 bytes} [Fri Aug 5 10:36:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 10:36:33.550656 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e6d5d0b8-b5e6-427c-804a-627098c6ddde tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] Calling method '.version_select at 0x7f732c2189d0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:33.584891 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-e6d5d0b8-b5e6-427c-804a-627098c6ddde tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] HTTP exception thrown: Volume tempest-invalid-130046867 could not be found. Aug 05 10:36:33.586911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e6d5d0b8-b5e6-427c-804a-627098c6ddde tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] Request method failure captured: Aug 05 10:36:33.586911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-130046867 HTTP/1.1 Aug 05 10:36:33.586911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:36:33.586911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:36:33.586911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:36:33.586911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:36:33.586911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:36:33.586911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:36:33.586911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:36:33.586911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:33.586911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PKxGkLkAEh2wfK0HRtIDRljOh0LjqPNeaU4dBBs6WHOefflC9--8NnQ9_Zh9YL79fsFP3UUgkgL5f1YrzI_c-_lHbJgAwBy7VdL5S0t3DcCJlzLrhfRqEOeVK06YlzWsRYb6B0bwj9e0hh1_kq9GMHD2scx99eFwNEMvcIyMibyLHA Aug 05 10:36:33.586911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:36:33.586911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:36:33.586911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:36:33.586911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:36:33.586911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:36:33.586911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:36:33.586911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 47fca44a92454bb9a829a30e1afc1bd2 Aug 05 10:36:33.586911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesNegativeTest-2077654204 Aug 05 10:36:33.586911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:36:33.586911 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:36:33.588410 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_47fca44a92454bb9a829a30e1afc1bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/47fca44a92454bb9a829a30e1afc1bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47fca44a92454bb9a829a30e1afc1bd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47fca44a92454bb9a829a30e1afc1bd2"}]}] Aug 05 10:36:33.588410 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesNegativeTest-2077654204 Aug 05 10:36:33.588410 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 47fca44a92454bb9a829a30e1afc1bd2 Aug 05 10:36:33.588410 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesNegativeTest-2077654204 Aug 05 10:36:33.588410 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesNegativeTest-2077654204-project Aug 05 10:36:33.588410 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:36:33.588410 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:36:33.588410 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: 763f482ab8a34ae881d2e6101c202dac Aug 05 10:36:33.588410 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesNegativeTest-2077654204-project Aug 05 10:36:33.588410 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: Aug 05 10:36:33.588410 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Volume tempest-invalid-130046867 could not be found. Aug 05 10:36:33.588410 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': 'tempest-invalid-130046867'} Aug 05 10:36:33.588410 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:33.589565 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:33.589565 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 10:36:33.589565 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 10:36:33.589565 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 10:36:33.589565 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 10:36:33.589565 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 10:36:33.589565 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 10:36:33.589565 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 10:36:33.589565 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 10:36:33.589565 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 10:36:33.589565 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 10:36:33.589565 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 10:36:33.589565 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 10:36:33.589565 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 10:36:33.589565 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 10:36:33.589565 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-130046867 could not be found. (HTTP 404) (Request-ID: req-223602e0-aab4-48f5-8ea9-29a04f6f3f84) Aug 05 10:36:33.589565 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.589565 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:33.589565 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.590884 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:33.590884 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 10:36:33.590884 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 10:36:33.590884 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 10:36:33.590884 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 10:36:33.590884 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 10:36:33.590884 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 10:36:33.590884 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 10:36:33.590884 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 10:36:33.590884 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 10:36:33.590884 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 10:36:33.590884 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 10:36:33.590884 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 10:36:33.590884 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 10:36:33.590884 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 10:36:33.590884 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 10:36:33.590884 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 10:36:33.590884 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 10:36:33.590884 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 10:36:33.592363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 10:36:33.592363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 10:36:33.592363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 10:36:33.592363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 10:36:33.592363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-130046867 could not be found. Aug 05 10:36:33.592363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.592363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:33.592363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.592363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:33.592363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:33.592363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:33.592363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:33.592363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:33.592363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 10:36:33.592363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 10:36:33.592363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:33.592363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:33.592363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 10:36:33.592363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:33.592363 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-130046867 could not be found. Aug 05 10:36:33.593954 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.593954 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:33.593954 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.593954 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:33.593954 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:33.593954 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:33.593954 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:33.593954 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:33.593954 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-130046867 could not be found. Aug 05 10:36:33.593954 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.593954 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e6d5d0b8-b5e6-427c-804a-627098c6ddde tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] Returning 404 to user: Volume tempest-invalid-130046867 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:33.593954 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e6d5d0b8-b5e6-427c-804a-627098c6ddde tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-130046867" status: 404 len: 98 microversion: 2.1 time: 0.042212 Aug 05 10:36:33.593954 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 567/1107] 10.222.0.40 () {58 vars in 1215 bytes} [Fri Aug 5 10:36:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-130046867 => generated 98 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 05 10:36:33.600039 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-a41d8969-9ec7-4553-9347-c833b07fbfcf tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003880 Aug 05 10:36:33.600531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 541/1108] 10.222.0.40 () {58 vars in 1140 bytes} [Fri Aug 5 10:36:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 05 10:36:33.609347 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6f44c706-31f4-4c81-8ce5-1e51e4d0427f tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004205 Aug 05 10:36:33.609824 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 568/1109] 10.222.0.40 () {58 vars in 1137 bytes} [Fri Aug 5 10:36:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 05 10:36:33.619131 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-35e2b71d-ef9d-4fd3-a540-d6c90dbf991f tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] Calling method '.version_select at 0x7f73274d7670>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:33.649321 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-35e2b71d-ef9d-4fd3-a540-d6c90dbf991f tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] HTTP exception thrown: Volume 61625103-006a-44d5-b340-d727a680f35e could not be found. Aug 05 10:36:33.651308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-35e2b71d-ef9d-4fd3-a540-d6c90dbf991f tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] Request method failure captured: Aug 05 10:36:33.651308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: DELETE /compute/v2.1/os-volumes/61625103-006a-44d5-b340-d727a680f35e HTTP/1.1 Aug 05 10:36:33.651308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:36:33.651308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:36:33.651308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:36:33.651308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:36:33.651308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:36:33.651308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:36:33.651308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:36:33.651308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:33.651308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PKxGkLkAEh2wfK0HRtIDRljOh0LjqPNeaU4dBBs6WHOefflC9--8NnQ9_Zh9YL79fsFP3UUgkgL5f1YrzI_c-_lHbJgAwBy7VdL5S0t3DcCJlzLrhfRqEOeVK06YlzWsRYb6B0bwj9e0hh1_kq9GMHD2scx99eFwNEMvcIyMibyLHA Aug 05 10:36:33.651308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:36:33.651308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:36:33.651308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:36:33.651308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:36:33.651308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:36:33.651308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:36:33.651308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 47fca44a92454bb9a829a30e1afc1bd2 Aug 05 10:36:33.651308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-VolumesNegativeTest-2077654204 Aug 05 10:36:33.651308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:36:33.651308 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:36:33.652775 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_47fca44a92454bb9a829a30e1afc1bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/47fca44a92454bb9a829a30e1afc1bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47fca44a92454bb9a829a30e1afc1bd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47fca44a92454bb9a829a30e1afc1bd2"}]}] Aug 05 10:36:33.652775 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-VolumesNegativeTest-2077654204 Aug 05 10:36:33.652775 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 47fca44a92454bb9a829a30e1afc1bd2 Aug 05 10:36:33.652775 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-VolumesNegativeTest-2077654204 Aug 05 10:36:33.652775 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-VolumesNegativeTest-2077654204-project Aug 05 10:36:33.652775 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:36:33.652775 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:36:33.652775 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: 763f482ab8a34ae881d2e6101c202dac Aug 05 10:36:33.652775 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-VolumesNegativeTest-2077654204-project Aug 05 10:36:33.652775 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: Aug 05 10:36:33.652775 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Volume 61625103-006a-44d5-b340-d727a680f35e could not be found. Aug 05 10:36:33.652775 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'id': '61625103-006a-44d5-b340-d727a680f35e'} Aug 05 10:36:33.652775 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:33.653668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:33.653668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 10:36:33.653668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 10:36:33.653668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 10:36:33.653668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 10:36:33.653668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 10:36:33.653668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 10:36:33.653668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 10:36:33.653668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 10:36:33.653668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 10:36:33.653668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 10:36:33.653668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 10:36:33.653668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 10:36:33.653668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 10:36:33.653668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 10:36:33.653668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 61625103-006a-44d5-b340-d727a680f35e could not be found. (HTTP 404) (Request-ID: req-f8928fea-ffb4-4f7d-a7a8-17b35abd1dfc) Aug 05 10:36:33.653668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.653668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:33.653668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.655097 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:33.655097 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 10:36:33.655097 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 10:36:33.655097 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 10:36:33.655097 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 10:36:33.655097 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 10:36:33.655097 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 10:36:33.655097 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 10:36:33.655097 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 10:36:33.655097 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 10:36:33.655097 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 10:36:33.655097 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 10:36:33.655097 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 10:36:33.655097 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 10:36:33.655097 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 10:36:33.655097 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 10:36:33.655097 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 10:36:33.655097 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 10:36:33.655097 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 10:36:33.656336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 10:36:33.656336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 10:36:33.656336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 10:36:33.656336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 10:36:33.656336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 61625103-006a-44d5-b340-d727a680f35e could not be found. Aug 05 10:36:33.656336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.656336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:33.656336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.656336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:33.656336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:33.656336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:33.656336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:33.656336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:33.656336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 10:36:33.656336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 10:36:33.656336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:33.656336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:33.656336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 10:36:33.656336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:33.657505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 61625103-006a-44d5-b340-d727a680f35e could not be found. Aug 05 10:36:33.657505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.657505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:33.657505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.657505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:33.657505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:33.657505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:33.657505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:33.657505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:33.657505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 61625103-006a-44d5-b340-d727a680f35e could not be found. Aug 05 10:36:33.657505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.657505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-35e2b71d-ef9d-4fd3-a540-d6c90dbf991f tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] Returning 404 to user: Volume 61625103-006a-44d5-b340-d727a680f35e could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:33.657505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-35e2b71d-ef9d-4fd3-a540-d6c90dbf991f tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/61625103-006a-44d5-b340-d727a680f35e" status: 404 len: 109 microversion: 2.1 time: 0.038253 Aug 05 10:36:33.657505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 542/1110] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 5 10:36:33 2022] DELETE /compute/v2.1/os-volumes/61625103-006a-44d5-b340-d727a680f35e => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 10:36:33.662809 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-affc5d1e-cd33-4492-b0d4-833fc5639d2f tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] Calling method '.version_select at 0x7f732760f1f0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:33.691429 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-affc5d1e-cd33-4492-b0d4-833fc5639d2f tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] HTTP exception thrown: Volume ffcc3780-1f91-4d97-8806-2047eea5672a could not be found. Aug 05 10:36:33.693320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-affc5d1e-cd33-4492-b0d4-833fc5639d2f tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] Request method failure captured: Aug 05 10:36:33.693320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/os-volumes/ffcc3780-1f91-4d97-8806-2047eea5672a HTTP/1.1 Aug 05 10:36:33.693320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:36:33.693320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:36:33.693320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:36:33.693320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:36:33.693320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:36:33.693320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:36:33.693320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:36:33.693320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:33.693320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PKxGkLkAEh2wfK0HRtIDRljOh0LjqPNeaU4dBBs6WHOefflC9--8NnQ9_Zh9YL79fsFP3UUgkgL5f1YrzI_c-_lHbJgAwBy7VdL5S0t3DcCJlzLrhfRqEOeVK06YlzWsRYb6B0bwj9e0hh1_kq9GMHD2scx99eFwNEMvcIyMibyLHA Aug 05 10:36:33.693320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:36:33.693320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:36:33.693320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:36:33.693320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:36:33.693320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:36:33.693320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:36:33.693320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 47fca44a92454bb9a829a30e1afc1bd2 Aug 05 10:36:33.693320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesNegativeTest-2077654204 Aug 05 10:36:33.693320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:36:33.693320 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:36:33.695013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_47fca44a92454bb9a829a30e1afc1bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/47fca44a92454bb9a829a30e1afc1bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47fca44a92454bb9a829a30e1afc1bd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47fca44a92454bb9a829a30e1afc1bd2"}]}] Aug 05 10:36:33.695013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesNegativeTest-2077654204 Aug 05 10:36:33.695013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 47fca44a92454bb9a829a30e1afc1bd2 Aug 05 10:36:33.695013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesNegativeTest-2077654204 Aug 05 10:36:33.695013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesNegativeTest-2077654204-project Aug 05 10:36:33.695013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:36:33.695013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:36:33.695013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: 763f482ab8a34ae881d2e6101c202dac Aug 05 10:36:33.695013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesNegativeTest-2077654204-project Aug 05 10:36:33.695013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: Aug 05 10:36:33.695013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Volume ffcc3780-1f91-4d97-8806-2047eea5672a could not be found. Aug 05 10:36:33.695013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': 'ffcc3780-1f91-4d97-8806-2047eea5672a'} Aug 05 10:36:33.695013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:33.695986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:33.695986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 10:36:33.695986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 10:36:33.695986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 10:36:33.695986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 10:36:33.695986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 10:36:33.695986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 10:36:33.695986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 10:36:33.695986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 10:36:33.695986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 10:36:33.695986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 10:36:33.695986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 10:36:33.695986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 10:36:33.695986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 10:36:33.695986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 10:36:33.695986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ffcc3780-1f91-4d97-8806-2047eea5672a could not be found. (HTTP 404) (Request-ID: req-9a09539d-31eb-417c-8dda-5c9ec5eedb3e) Aug 05 10:36:33.695986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.695986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:33.695986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.697417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:33.697417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 10:36:33.697417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 10:36:33.697417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 10:36:33.697417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 10:36:33.697417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 10:36:33.697417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 10:36:33.697417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 10:36:33.697417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 10:36:33.697417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 10:36:33.697417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 10:36:33.697417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 10:36:33.697417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 10:36:33.697417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 10:36:33.697417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 10:36:33.697417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 10:36:33.697417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 10:36:33.697417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 10:36:33.697417 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 10:36:33.698873 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 10:36:33.698873 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 10:36:33.698873 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 10:36:33.698873 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 10:36:33.698873 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ffcc3780-1f91-4d97-8806-2047eea5672a could not be found. Aug 05 10:36:33.698873 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.698873 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:33.698873 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.698873 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:33.698873 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:33.698873 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:33.698873 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:33.698873 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:33.698873 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 10:36:33.698873 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 10:36:33.698873 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:33.698873 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:33.698873 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 10:36:33.698873 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:33.701187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ffcc3780-1f91-4d97-8806-2047eea5672a could not be found. Aug 05 10:36:33.701187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.701187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:33.701187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.701187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:33.701187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:33.701187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:33.701187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:33.701187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:33.701187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ffcc3780-1f91-4d97-8806-2047eea5672a could not be found. Aug 05 10:36:33.701187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:33.701187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-affc5d1e-cd33-4492-b0d4-833fc5639d2f tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] Returning 404 to user: Volume ffcc3780-1f91-4d97-8806-2047eea5672a could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:33.701187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-affc5d1e-cd33-4492-b0d4-833fc5639d2f tempest-VolumesNegativeTest-2077654204 tempest-VolumesNegativeTest-2077654204-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/ffcc3780-1f91-4d97-8806-2047eea5672a" status: 404 len: 109 microversion: 2.1 time: 0.035708 Aug 05 10:36:33.701187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 569/1111] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 5 10:36:33 2022] GET /compute/v2.1/os-volumes/ffcc3780-1f91-4d97-8806-2047eea5672a => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:36:40.185309 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=23 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:36:40.186962 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:36:40.195496 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-2ba8e04c-56f3-40fa-9028-3864c6570b14 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:40.199887 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-2ba8e04c-56f3-40fa-9028-3864c6570b14 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:40.215320 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2ba8e04c-56f3-40fa-9028-3864c6570b14 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:40.216297 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2ba8e04c-56f3-40fa-9028-3864c6570b14 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:40.217030 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2ba8e04c-56f3-40fa-9028-3864c6570b14 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:40.218217 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2ba8e04c-56f3-40fa-9028-3864c6570b14 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:40.218817 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2ba8e04c-56f3-40fa-9028-3864c6570b14 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:40.219415 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2ba8e04c-56f3-40fa-9028-3864c6570b14 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:40.252012 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-2ba8e04c-56f3-40fa-9028-3864c6570b14 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.068107 Aug 05 10:36:40.252818 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 543/1112] 10.222.0.40 () {60 vars in 1343 bytes} [Fri Aug 5 10:36:40 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:36:40.313947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:36:40.314814 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=38,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:36:40.320206 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c2846eb6-e89b-4c6e-8e4b-c348404ef835 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:40.320703 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c2846eb6-e89b-4c6e-8e4b-c348404ef835 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:40.329098 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c2846eb6-e89b-4c6e-8e4b-c348404ef835 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:40.329710 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c2846eb6-e89b-4c6e-8e4b-c348404ef835 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:40.330153 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c2846eb6-e89b-4c6e-8e4b-c348404ef835 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:40.330943 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c2846eb6-e89b-4c6e-8e4b-c348404ef835 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:40.331393 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c2846eb6-e89b-4c6e-8e4b-c348404ef835 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:40.331815 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c2846eb6-e89b-4c6e-8e4b-c348404ef835 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:40.359262 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c2846eb6-e89b-4c6e-8e4b-c348404ef835 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 10:36:40.443000 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c2846eb6-e89b-4c6e-8e4b-c348404ef835 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "DELETE /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 204 len: 0 microversion: 2.20 time: 0.130668 Aug 05 10:36:40.443795 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 570/1113] 10.222.0.40 () {60 vars in 1280 bytes} [Fri Aug 5 10:36:40 2022] DELETE /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 10:36:40.453232 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-9ab6672c-35ec-4948-be47-0ae81ae217a6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:40.453850 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-9ab6672c-35ec-4948-be47-0ae81ae217a6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:40.459829 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9ab6672c-35ec-4948-be47-0ae81ae217a6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:40.460322 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9ab6672c-35ec-4948-be47-0ae81ae217a6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:40.460768 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9ab6672c-35ec-4948-be47-0ae81ae217a6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:40.461464 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9ab6672c-35ec-4948-be47-0ae81ae217a6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:40.462021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9ab6672c-35ec-4948-be47-0ae81ae217a6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:40.462456 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9ab6672c-35ec-4948-be47-0ae81ae217a6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:40.609686 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-9ab6672c-35ec-4948-be47-0ae81ae217a6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:36:40.619140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-9ab6672c-35ec-4948-be47-0ae81ae217a6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:36:40.621194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-9ab6672c-35ec-4948-be47-0ae81ae217a6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:36:40.622413 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-9ab6672c-35ec-4948-be47-0ae81ae217a6 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1724 microversion: 2.20 time: 0.174141 Aug 05 10:36:40.623174 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 544/1114] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:36:40 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 10:36:41.646754 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8d46f26e-7c70-4e8b-a014-39d09b7a9477 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:41.647731 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8d46f26e-7c70-4e8b-a014-39d09b7a9477 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:41.655275 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d46f26e-7c70-4e8b-a014-39d09b7a9477 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:41.655844 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d46f26e-7c70-4e8b-a014-39d09b7a9477 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:41.656277 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d46f26e-7c70-4e8b-a014-39d09b7a9477 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:41.657080 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d46f26e-7c70-4e8b-a014-39d09b7a9477 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:41.657647 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d46f26e-7c70-4e8b-a014-39d09b7a9477 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:41.658142 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d46f26e-7c70-4e8b-a014-39d09b7a9477 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:41.815619 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8d46f26e-7c70-4e8b-a014-39d09b7a9477 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:36:41.824676 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8d46f26e-7c70-4e8b-a014-39d09b7a9477 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:36:41.826378 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8d46f26e-7c70-4e8b-a014-39d09b7a9477 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:36:41.827793 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8d46f26e-7c70-4e8b-a014-39d09b7a9477 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1724 microversion: 2.20 time: 0.185654 Aug 05 10:36:41.828356 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 571/1115] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:36:41 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:36:42.854629 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-6bb93ecd-f2a5-424e-b8cd-7f4826b5afe5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:42.855571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-6bb93ecd-f2a5-424e-b8cd-7f4826b5afe5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:42.866154 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6bb93ecd-f2a5-424e-b8cd-7f4826b5afe5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:42.866970 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6bb93ecd-f2a5-424e-b8cd-7f4826b5afe5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:42.867741 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6bb93ecd-f2a5-424e-b8cd-7f4826b5afe5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:42.868888 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6bb93ecd-f2a5-424e-b8cd-7f4826b5afe5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:42.869647 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6bb93ecd-f2a5-424e-b8cd-7f4826b5afe5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:42.870362 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6bb93ecd-f2a5-424e-b8cd-7f4826b5afe5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:43.009062 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-6bb93ecd-f2a5-424e-b8cd-7f4826b5afe5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:36:43.018438 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-6bb93ecd-f2a5-424e-b8cd-7f4826b5afe5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:36:43.019985 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-6bb93ecd-f2a5-424e-b8cd-7f4826b5afe5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:36:43.021127 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-6bb93ecd-f2a5-424e-b8cd-7f4826b5afe5 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1724 microversion: 2.20 time: 0.173392 Aug 05 10:36:43.021686 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 545/1116] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:36:42 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:36:44.043993 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-22eea398-6bb8-4b54-88fd-f6cd8f9a8d46 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:44.044677 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-22eea398-6bb8-4b54-88fd-f6cd8f9a8d46 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:44.052058 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-22eea398-6bb8-4b54-88fd-f6cd8f9a8d46 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:44.052539 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-22eea398-6bb8-4b54-88fd-f6cd8f9a8d46 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:44.053087 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-22eea398-6bb8-4b54-88fd-f6cd8f9a8d46 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:44.053799 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-22eea398-6bb8-4b54-88fd-f6cd8f9a8d46 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:44.054251 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-22eea398-6bb8-4b54-88fd-f6cd8f9a8d46 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:44.054671 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-22eea398-6bb8-4b54-88fd-f6cd8f9a8d46 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:44.128955 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-22eea398-6bb8-4b54-88fd-f6cd8f9a8d46 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:36:44.137812 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-22eea398-6bb8-4b54-88fd-f6cd8f9a8d46 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:36:44.139671 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-22eea398-6bb8-4b54-88fd-f6cd8f9a8d46 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:36:44.140818 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-22eea398-6bb8-4b54-88fd-f6cd8f9a8d46 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1656 microversion: 2.20 time: 0.100889 Aug 05 10:36:44.141366 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 572/1117] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:36:44 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1656 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:36:44.397637 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-3331cb87-47b3-442c-b213-9450ccbc38a8 req-f88c680b-e846-44a9-8f77-4772481b2462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6a3f62-cb68-4fa9-8c79-b99880a9e1ca", "name": "network-vif-deleted", "tag": "98cf9379-6188-4844-b4f6-4476ddfb8a7d"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:36:44.408092 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-3331cb87-47b3-442c-b213-9450ccbc38a8 req-f88c680b-e846-44a9-8f77-4772481b2462 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:44.408569 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-3331cb87-47b3-442c-b213-9450ccbc38a8 req-f88c680b-e846-44a9-8f77-4772481b2462 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:44.409015 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-3331cb87-47b3-442c-b213-9450ccbc38a8 req-f88c680b-e846-44a9-8f77-4772481b2462 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:44.420834 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-3331cb87-47b3-442c-b213-9450ccbc38a8 req-f88c680b-e846-44a9-8f77-4772481b2462 service nova] Creating event network-vif-deleted:98cf9379-6188-4844-b4f6-4476ddfb8a7d for instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca on hv-cinder-81558 Aug 05 10:36:44.425945 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-3331cb87-47b3-442c-b213-9450ccbc38a8 req-f88c680b-e846-44a9-8f77-4772481b2462 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032011 Aug 05 10:36:44.426566 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 546/1118] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:36:45.170770 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d3e951c0-0545-4306-b649-c793390f3dd8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:45.173880 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d3e951c0-0545-4306-b649-c793390f3dd8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:45.183624 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3e951c0-0545-4306-b649-c793390f3dd8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:45.184196 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3e951c0-0545-4306-b649-c793390f3dd8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:45.184621 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3e951c0-0545-4306-b649-c793390f3dd8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:45.185519 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3e951c0-0545-4306-b649-c793390f3dd8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:45.185981 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3e951c0-0545-4306-b649-c793390f3dd8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:45.186374 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3e951c0-0545-4306-b649-c793390f3dd8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:45.253252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d3e951c0-0545-4306-b649-c793390f3dd8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:36:45.261789 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d3e951c0-0545-4306-b649-c793390f3dd8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:36:45.263335 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d3e951c0-0545-4306-b649-c793390f3dd8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97f671de92d240ae85ca4893d1ff04e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a1fa6b4a754e47afb99e9b237ea400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:36:45.264890 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d3e951c0-0545-4306-b649-c793390f3dd8 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 200 len: 1656 microversion: 2.20 time: 0.103647 Aug 05 10:36:45.265704 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 573/1119] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:36:45 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 1656 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 10:36:46.290118 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-90240fc3-2bfa-4478-b0ec-d1db88accb96 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:46.290805 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-90240fc3-2bfa-4478-b0ec-d1db88accb96 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:46.297509 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-90240fc3-2bfa-4478-b0ec-d1db88accb96 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:46.297984 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-90240fc3-2bfa-4478-b0ec-d1db88accb96 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:46.298416 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-90240fc3-2bfa-4478-b0ec-d1db88accb96 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:46.299142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-90240fc3-2bfa-4478-b0ec-d1db88accb96 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:46.299592 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-90240fc3-2bfa-4478-b0ec-d1db88accb96 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:46.299991 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-90240fc3-2bfa-4478-b0ec-d1db88accb96 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:46.314160 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-90240fc3-2bfa-4478-b0ec-d1db88accb96 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] HTTP exception thrown: Instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca could not be found. Aug 05 10:36:46.315800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-90240fc3-2bfa-4478-b0ec-d1db88accb96 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Request method failure captured: Aug 05 10:36:46.315800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca HTTP/1.1 Aug 05 10:36:46.315800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:36:46.315800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:36:46.315800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:36:46.315800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:36:46.315800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:36:46.315800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:36:46.315800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:36:46.315800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:46.315800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PBZO8RhFL-wHmpwJ5QJvc72mNkNYvZ8q0uG0FC-Fp1d2PpDrB0syMdLDDpwqBZNo6jtUo3FJEcmyawFXZsvKF20RTKPh3QbG4_FaYkt32Ou8SiBjxBGpshmcupc39RVzRXU4AcSvV1FCXutQBxrdPg4Oj2SEWSZhtrYFFLA2_I7X6E Aug 05 10:36:46.315800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:36:46.315800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:36:46.315800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:36:46.315800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:36:46.315800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 10:36:46.315800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:36:46.315800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:36:46.315800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 36a1fa6b4a754e47afb99e9b237ea400 Aug 05 10:36:46.315800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-192289825 Aug 05 10:36:46.315800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:36:46.315800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:36:46.317542 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_36a1fa6b4a754e47afb99e9b237ea400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/36a1fa6b4a754e47afb99e9b237ea400"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/36a1fa6b4a754e47afb99e9b237ea400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/36a1fa6b4a754e47afb99e9b237ea400"}]}] Aug 05 10:36:46.317542 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-AttachVolumeShelveTestJSON-192289825 Aug 05 10:36:46.317542 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 36a1fa6b4a754e47afb99e9b237ea400 Aug 05 10:36:46.317542 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-192289825 Aug 05 10:36:46.317542 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-AttachVolumeShelveTestJSON-192289825-project Aug 05 10:36:46.317542 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:36:46.317542 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:36:46.317542 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: 97f671de92d240ae85ca4893d1ff04e5 Aug 05 10:36:46.317542 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-AttachVolumeShelveTestJSON-192289825-project Aug 05 10:36:46.317542 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: > Aug 05 10:36:46.317542 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca could not be found. Aug 05 10:36:46.317542 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'id': 'de6a3f62-cb68-4fa9-8c79-b99880a9e1ca'} Aug 05 10:36:46.318604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:46.318604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:46.318604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:36:46.318604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:36:46.318604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:36:46.318604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:36:46.318604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:36:46.318604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:36:46.318604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:36:46.318604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:36:46.318604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca could not be found. Aug 05 10:36:46.318604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:46.318604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:46.318604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:46.318604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:46.318604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:46.318604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:46.318604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:46.318604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:46.318604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:46.320288 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:46.320288 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:36:46.320288 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:36:46.320288 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:36:46.320288 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:36:46.320288 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:36:46.320288 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:46.320288 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca could not be found. Aug 05 10:36:46.320288 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:46.320288 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:46.320288 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:46.320288 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:46.320288 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:46.320288 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:46.320288 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:46.320288 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:46.320288 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca could not be found. Aug 05 10:36:46.320288 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:46.321679 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-90240fc3-2bfa-4478-b0ec-d1db88accb96 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Returning 404 to user: Instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:46.321679 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-90240fc3-2bfa-4478-b0ec-d1db88accb96 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 404 len: 111 microversion: 2.20 time: 0.032946 Aug 05 10:36:46.321679 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 547/1120] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:36:46 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 10:36:46.327849 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5388fc3c-56be-4a48-83e2-83de0fbd3fea tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '.version_select at 0x7f7327772d30>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:46.349887 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5388fc3c-56be-4a48-83e2-83de0fbd3fea tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1730547715" status: 204 len: 0 microversion: 2.20 time: 0.025944 Aug 05 10:36:46.350451 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 574/1121] 10.222.0.40 () {60 vars in 1262 bytes} [Fri Aug 5 10:36:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1730547715 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 05 10:36:48.326412 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-254e0d12-7d80-4e6d-bf98-0132e7799bc3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:48.326955 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-254e0d12-7d80-4e6d-bf98-0132e7799bc3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:48.334063 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-254e0d12-7d80-4e6d-bf98-0132e7799bc3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:48.334541 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-254e0d12-7d80-4e6d-bf98-0132e7799bc3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:48.335010 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-254e0d12-7d80-4e6d-bf98-0132e7799bc3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:48.335704 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-254e0d12-7d80-4e6d-bf98-0132e7799bc3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:48.336154 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-254e0d12-7d80-4e6d-bf98-0132e7799bc3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:48.336580 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-254e0d12-7d80-4e6d-bf98-0132e7799bc3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:48.350867 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-254e0d12-7d80-4e6d-bf98-0132e7799bc3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] HTTP exception thrown: Instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca could not be found. Aug 05 10:36:48.352444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-254e0d12-7d80-4e6d-bf98-0132e7799bc3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Request method failure captured: Aug 05 10:36:48.352444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: DELETE /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca HTTP/1.1 Aug 05 10:36:48.352444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:36:48.352444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:36:48.352444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:36:48.352444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:36:48.352444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:36:48.352444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:36:48.352444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:36:48.352444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:48.352444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PBZO8RhFL-wHmpwJ5QJvc72mNkNYvZ8q0uG0FC-Fp1d2PpDrB0syMdLDDpwqBZNo6jtUo3FJEcmyawFXZsvKF20RTKPh3QbG4_FaYkt32Ou8SiBjxBGpshmcupc39RVzRXU4AcSvV1FCXutQBxrdPg4Oj2SEWSZhtrYFFLA2_I7X6E Aug 05 10:36:48.352444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:36:48.352444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:36:48.352444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:36:48.352444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:36:48.352444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 10:36:48.352444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:36:48.352444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:36:48.352444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 36a1fa6b4a754e47afb99e9b237ea400 Aug 05 10:36:48.352444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-192289825 Aug 05 10:36:48.352444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:36:48.352444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:36:48.353964 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_36a1fa6b4a754e47afb99e9b237ea400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/36a1fa6b4a754e47afb99e9b237ea400"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/36a1fa6b4a754e47afb99e9b237ea400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/36a1fa6b4a754e47afb99e9b237ea400"}]}] Aug 05 10:36:48.353964 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-AttachVolumeShelveTestJSON-192289825 Aug 05 10:36:48.353964 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 36a1fa6b4a754e47afb99e9b237ea400 Aug 05 10:36:48.353964 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-192289825 Aug 05 10:36:48.353964 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-AttachVolumeShelveTestJSON-192289825-project Aug 05 10:36:48.353964 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:36:48.353964 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:36:48.353964 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: 97f671de92d240ae85ca4893d1ff04e5 Aug 05 10:36:48.353964 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-AttachVolumeShelveTestJSON-192289825-project Aug 05 10:36:48.353964 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: > Aug 05 10:36:48.353964 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca could not be found. Aug 05 10:36:48.353964 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'id': 'de6a3f62-cb68-4fa9-8c79-b99880a9e1ca'} Aug 05 10:36:48.355112 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:48.355112 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:48.355112 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:36:48.355112 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:36:48.355112 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:36:48.355112 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:36:48.355112 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:36:48.355112 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:36:48.355112 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:36:48.355112 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:36:48.355112 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca could not be found. Aug 05 10:36:48.355112 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:48.355112 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:48.355112 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:48.355112 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:48.355112 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:48.355112 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:48.355112 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:48.355112 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:48.355112 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:48.356781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:48.356781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 10:36:48.356781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 10:36:48.356781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 10:36:48.356781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 10:36:48.356781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:36:48.356781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:36:48.356781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:36:48.356781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:48.356781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca could not be found. Aug 05 10:36:48.356781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:48.356781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:48.356781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:48.356781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:48.356781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:48.356781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:48.356781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:48.356781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:48.356781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca could not be found. Aug 05 10:36:48.356781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:48.358581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-254e0d12-7d80-4e6d-bf98-0132e7799bc3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Returning 404 to user: Instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:48.358581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-254e0d12-7d80-4e6d-bf98-0132e7799bc3 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "DELETE /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 404 len: 111 microversion: 2.20 time: 0.031824 Aug 05 10:36:48.358581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 548/1122] 10.222.0.40 () {60 vars in 1280 bytes} [Fri Aug 5 10:36:48 2022] DELETE /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 10:36:48.362628 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4b03be33-4c0c-47ec-9a15-7a9615b37ee2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:48.363262 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4b03be33-4c0c-47ec-9a15-7a9615b37ee2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: de6a3f62-cb68-4fa9-8c79-b99880a9e1ca] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:48.371653 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4b03be33-4c0c-47ec-9a15-7a9615b37ee2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:48.372121 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4b03be33-4c0c-47ec-9a15-7a9615b37ee2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:48.372536 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4b03be33-4c0c-47ec-9a15-7a9615b37ee2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:48.373230 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4b03be33-4c0c-47ec-9a15-7a9615b37ee2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:48.373676 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4b03be33-4c0c-47ec-9a15-7a9615b37ee2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:48.374097 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4b03be33-4c0c-47ec-9a15-7a9615b37ee2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:48.390632 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-4b03be33-4c0c-47ec-9a15-7a9615b37ee2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] HTTP exception thrown: Instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca could not be found. Aug 05 10:36:48.392288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4b03be33-4c0c-47ec-9a15-7a9615b37ee2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Request method failure captured: Aug 05 10:36:48.392288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca HTTP/1.1 Aug 05 10:36:48.392288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:36:48.392288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:36:48.392288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:36:48.392288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:36:48.392288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:36:48.392288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:36:48.392288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:36:48.392288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:48.392288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PBZO8RhFL-wHmpwJ5QJvc72mNkNYvZ8q0uG0FC-Fp1d2PpDrB0syMdLDDpwqBZNo6jtUo3FJEcmyawFXZsvKF20RTKPh3QbG4_FaYkt32Ou8SiBjxBGpshmcupc39RVzRXU4AcSvV1FCXutQBxrdPg4Oj2SEWSZhtrYFFLA2_I7X6E Aug 05 10:36:48.392288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:36:48.392288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:36:48.392288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:36:48.392288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:36:48.392288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 10:36:48.392288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:36:48.392288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:36:48.392288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 36a1fa6b4a754e47afb99e9b237ea400 Aug 05 10:36:48.392288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-192289825 Aug 05 10:36:48.392288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:36:48.392288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:36:48.393881 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_36a1fa6b4a754e47afb99e9b237ea400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/36a1fa6b4a754e47afb99e9b237ea400"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/36a1fa6b4a754e47afb99e9b237ea400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/36a1fa6b4a754e47afb99e9b237ea400"}]}] Aug 05 10:36:48.393881 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeShelveTestJSON-192289825 Aug 05 10:36:48.393881 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 36a1fa6b4a754e47afb99e9b237ea400 Aug 05 10:36:48.393881 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-192289825 Aug 05 10:36:48.393881 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeShelveTestJSON-192289825-project Aug 05 10:36:48.393881 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:36:48.393881 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:36:48.393881 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: 97f671de92d240ae85ca4893d1ff04e5 Aug 05 10:36:48.393881 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeShelveTestJSON-192289825-project Aug 05 10:36:48.393881 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:36:48.393881 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca could not be found. Aug 05 10:36:48.393881 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': 'de6a3f62-cb68-4fa9-8c79-b99880a9e1ca'} Aug 05 10:36:48.395003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:48.395003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:48.395003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:36:48.395003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:36:48.395003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:36:48.395003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:36:48.395003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:36:48.395003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:36:48.395003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:36:48.395003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:36:48.395003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca could not be found. Aug 05 10:36:48.395003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:48.395003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:48.395003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:48.395003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:48.395003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:48.395003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:48.395003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:48.395003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:48.395003 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:48.396500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:48.396500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:36:48.396500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:36:48.396500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:36:48.396500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:36:48.396500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:36:48.396500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:48.396500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca could not be found. Aug 05 10:36:48.396500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:48.396500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:48.396500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:48.396500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:48.396500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:48.396500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:48.396500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:48.396500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:48.396500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca could not be found. Aug 05 10:36:48.396500 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:48.398061 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4b03be33-4c0c-47ec-9a15-7a9615b37ee2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Returning 404 to user: Instance de6a3f62-cb68-4fa9-8c79-b99880a9e1ca could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:48.398061 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4b03be33-4c0c-47ec-9a15-7a9615b37ee2 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca" status: 404 len: 111 microversion: 2.20 time: 0.035061 Aug 05 10:36:48.398061 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 575/1123] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:36:48 2022] GET /compute/v2.1/servers/de6a3f62-cb68-4fa9-8c79-b99880a9e1ca => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 10:36:49.541903 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-61ed021a-bb2e-49a6-b739-5389b7476fd7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:49.542410 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-61ed021a-bb2e-49a6-b739-5389b7476fd7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:49.552303 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-61ed021a-bb2e-49a6-b739-5389b7476fd7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:49.552923 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-61ed021a-bb2e-49a6-b739-5389b7476fd7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:49.553482 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-61ed021a-bb2e-49a6-b739-5389b7476fd7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:49.554553 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-61ed021a-bb2e-49a6-b739-5389b7476fd7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:49.555143 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-61ed021a-bb2e-49a6-b739-5389b7476fd7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:49.555603 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-61ed021a-bb2e-49a6-b739-5389b7476fd7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:49.570966 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-61ed021a-bb2e-49a6-b739-5389b7476fd7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] HTTP exception thrown: Instance af7c11c7-dddb-481d-9d57-af021c48e71b could not be found. Aug 05 10:36:49.572571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-61ed021a-bb2e-49a6-b739-5389b7476fd7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Request method failure captured: Aug 05 10:36:49.572571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: DELETE /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b HTTP/1.1 Aug 05 10:36:49.572571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:36:49.572571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:36:49.572571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:36:49.572571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:36:49.572571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:36:49.572571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:36:49.572571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:36:49.572571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:49.572571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PBZO8RhFL-wHmpwJ5QJvc72mNkNYvZ8q0uG0FC-Fp1d2PpDrB0syMdLDDpwqBZNo6jtUo3FJEcmyawFXZsvKF20RTKPh3QbG4_FaYkt32Ou8SiBjxBGpshmcupc39RVzRXU4AcSvV1FCXutQBxrdPg4Oj2SEWSZhtrYFFLA2_I7X6E Aug 05 10:36:49.572571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:36:49.572571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:36:49.572571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:36:49.572571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:36:49.572571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 10:36:49.572571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:36:49.572571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:36:49.572571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 36a1fa6b4a754e47afb99e9b237ea400 Aug 05 10:36:49.572571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-192289825 Aug 05 10:36:49.572571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:36:49.572571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:36:49.574008 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_36a1fa6b4a754e47afb99e9b237ea400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/36a1fa6b4a754e47afb99e9b237ea400"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/36a1fa6b4a754e47afb99e9b237ea400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/36a1fa6b4a754e47afb99e9b237ea400"}]}] Aug 05 10:36:49.574008 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-AttachVolumeShelveTestJSON-192289825 Aug 05 10:36:49.574008 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 36a1fa6b4a754e47afb99e9b237ea400 Aug 05 10:36:49.574008 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-192289825 Aug 05 10:36:49.574008 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-AttachVolumeShelveTestJSON-192289825-project Aug 05 10:36:49.574008 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:36:49.574008 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:36:49.574008 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: 97f671de92d240ae85ca4893d1ff04e5 Aug 05 10:36:49.574008 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-AttachVolumeShelveTestJSON-192289825-project Aug 05 10:36:49.574008 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: > Aug 05 10:36:49.574008 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Instance af7c11c7-dddb-481d-9d57-af021c48e71b could not be found. Aug 05 10:36:49.574008 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'id': 'af7c11c7-dddb-481d-9d57-af021c48e71b'} Aug 05 10:36:49.574752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:49.574752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:49.574752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:36:49.574752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:36:49.574752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:36:49.574752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:36:49.574752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:36:49.574752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:36:49.574752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:36:49.574752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:36:49.574752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7c11c7-dddb-481d-9d57-af021c48e71b could not be found. Aug 05 10:36:49.574752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:49.574752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:49.574752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:49.574752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:49.574752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:49.574752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:49.574752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:49.574752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:49.574752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:49.576231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:49.576231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 10:36:49.576231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 10:36:49.576231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 10:36:49.576231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 10:36:49.576231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:36:49.576231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:36:49.576231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:36:49.576231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:49.576231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7c11c7-dddb-481d-9d57-af021c48e71b could not be found. Aug 05 10:36:49.576231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:49.576231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:49.576231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:49.576231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:49.576231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:49.576231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:49.576231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:49.576231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:49.576231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7c11c7-dddb-481d-9d57-af021c48e71b could not be found. Aug 05 10:36:49.576231 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:36:49.578030 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-61ed021a-bb2e-49a6-b739-5389b7476fd7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Returning 404 to user: Instance af7c11c7-dddb-481d-9d57-af021c48e71b could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:49.578030 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-61ed021a-bb2e-49a6-b739-5389b7476fd7 tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "DELETE /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 404 len: 111 microversion: 2.20 time: 0.038434 Aug 05 10:36:49.578030 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 549/1124] 10.222.0.40 () {60 vars in 1280 bytes} [Fri Aug 5 10:36:49 2022] DELETE /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 10:36:49.584271 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ec0d8d68-6111-4605-aece-8c7134f666fd tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:36:49.584885 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ec0d8d68-6111-4605-aece-8c7134f666fd tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] [instance: af7c11c7-dddb-481d-9d57-af021c48e71b] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:36:49.591533 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec0d8d68-6111-4605-aece-8c7134f666fd tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:49.592007 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec0d8d68-6111-4605-aece-8c7134f666fd tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:49.592437 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec0d8d68-6111-4605-aece-8c7134f666fd tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:49.593129 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec0d8d68-6111-4605-aece-8c7134f666fd tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:36:49.593581 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec0d8d68-6111-4605-aece-8c7134f666fd tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:36:49.594001 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec0d8d68-6111-4605-aece-8c7134f666fd tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:36:49.607498 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-ec0d8d68-6111-4605-aece-8c7134f666fd tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] HTTP exception thrown: Instance af7c11c7-dddb-481d-9d57-af021c48e71b could not be found. Aug 05 10:36:49.609018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ec0d8d68-6111-4605-aece-8c7134f666fd tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Request method failure captured: Aug 05 10:36:49.609018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b HTTP/1.1 Aug 05 10:36:49.609018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:36:49.609018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:36:49.609018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:36:49.609018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:36:49.609018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:36:49.609018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:36:49.609018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:36:49.609018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:36:49.609018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PBZO8RhFL-wHmpwJ5QJvc72mNkNYvZ8q0uG0FC-Fp1d2PpDrB0syMdLDDpwqBZNo6jtUo3FJEcmyawFXZsvKF20RTKPh3QbG4_FaYkt32Ou8SiBjxBGpshmcupc39RVzRXU4AcSvV1FCXutQBxrdPg4Oj2SEWSZhtrYFFLA2_I7X6E Aug 05 10:36:49.609018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:36:49.609018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:36:49.609018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:36:49.609018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:36:49.609018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 10:36:49.609018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:36:49.609018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:36:49.609018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 36a1fa6b4a754e47afb99e9b237ea400 Aug 05 10:36:49.609018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-192289825 Aug 05 10:36:49.609018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:36:49.609018 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:36:49.610614 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_36a1fa6b4a754e47afb99e9b237ea400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/36a1fa6b4a754e47afb99e9b237ea400"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/36a1fa6b4a754e47afb99e9b237ea400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/36a1fa6b4a754e47afb99e9b237ea400"}]}] Aug 05 10:36:49.610614 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeShelveTestJSON-192289825 Aug 05 10:36:49.610614 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 36a1fa6b4a754e47afb99e9b237ea400 Aug 05 10:36:49.610614 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-192289825 Aug 05 10:36:49.610614 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeShelveTestJSON-192289825-project Aug 05 10:36:49.610614 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:36:49.610614 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:36:49.610614 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: 97f671de92d240ae85ca4893d1ff04e5 Aug 05 10:36:49.610614 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeShelveTestJSON-192289825-project Aug 05 10:36:49.610614 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:36:49.610614 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Instance af7c11c7-dddb-481d-9d57-af021c48e71b could not be found. Aug 05 10:36:49.610614 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': 'af7c11c7-dddb-481d-9d57-af021c48e71b'} Aug 05 10:36:49.611718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:36:49.611718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:49.611718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:36:49.611718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:36:49.611718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:36:49.611718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:36:49.611718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:36:49.611718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:36:49.611718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:36:49.611718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:36:49.611718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7c11c7-dddb-481d-9d57-af021c48e71b could not be found. Aug 05 10:36:49.611718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:49.611718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:49.611718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:49.611718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:49.611718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:49.611718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:49.611718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:36:49.611718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:36:49.611718 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:36:49.613212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:36:49.613212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:36:49.613212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:36:49.613212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:36:49.613212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:36:49.613212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:36:49.613212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:36:49.613212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7c11c7-dddb-481d-9d57-af021c48e71b could not be found. Aug 05 10:36:49.613212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:49.613212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:36:49.613212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:49.613212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:36:49.613212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:36:49.613212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:36:49.613212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:36:49.613212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:36:49.613212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7c11c7-dddb-481d-9d57-af021c48e71b could not be found. Aug 05 10:36:49.613212 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:36:49.614748 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ec0d8d68-6111-4605-aece-8c7134f666fd tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] Returning 404 to user: Instance af7c11c7-dddb-481d-9d57-af021c48e71b could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:36:49.614748 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ec0d8d68-6111-4605-aece-8c7134f666fd tempest-AttachVolumeShelveTestJSON-192289825 tempest-AttachVolumeShelveTestJSON-192289825-project] 10.222.0.40 "GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b" status: 404 len: 111 microversion: 2.20 time: 0.030085 Aug 05 10:36:49.614748 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 576/1125] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 5 10:36:49 2022] GET /compute/v2.1/servers/af7c11c7-dddb-481d-9d57-af021c48e71b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 10:37:12.702206 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d41c5da5-79c8-48bc-b3c7-2c85fa2fd11c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1985709088", "imageRef": "6163bb7c-dfd7-4fb1-a3cb-9f4818243f78", "flavorRef": "452", "networks": [{"uuid": "d8703152-44d8-49a4-b955-8031363f929c"}]}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:37:12.714307 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=14 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:37:12.715351 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=26 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:37:12.765330 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.network.neutron [None req-d41c5da5-79c8-48bc-b3c7-2c85fa2fd11c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] validate_networks() for [('d8703152-44d8-49a4-b955-8031363f929c', None, None, None, None, None)] {{(pid=117831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 10:37:13.153258 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-d41c5da5-79c8-48bc-b3c7-2c85fa2fd11c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Flavor limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 10:37:13.153677 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-d41c5da5-79c8-48bc-b3c7-2c85fa2fd11c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Image limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 10:37:13.154143 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-d41c5da5-79c8-48bc-b3c7-2c85fa2fd11c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Flavor pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 10:37:13.154544 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-d41c5da5-79c8-48bc-b3c7-2c85fa2fd11c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Image pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 10:37:13.154982 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-d41c5da5-79c8-48bc-b3c7-2c85fa2fd11c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 10:37:13.166021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d41c5da5-79c8-48bc-b3c7-2c85fa2fd11c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:13.166624 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d41c5da5-79c8-48bc-b3c7-2c85fa2fd11c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:13.167211 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d41c5da5-79c8-48bc-b3c7-2c85fa2fd11c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:13.168805 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d41c5da5-79c8-48bc-b3c7-2c85fa2fd11c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:13.169471 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d41c5da5-79c8-48bc-b3c7-2c85fa2fd11c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:13.170424 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d41c5da5-79c8-48bc-b3c7-2c85fa2fd11c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:13.188419 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-d41c5da5-79c8-48bc-b3c7-2c85fa2fd11c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Getting quotas for project 2bbcb32efae644d8b8ab1c92fb168a7b. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:37:13.193154 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-d41c5da5-79c8-48bc-b3c7-2c85fa2fd11c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Getting quotas for user 85904ab7159f486ea9d5075b285148f7 and project 2bbcb32efae644d8b8ab1c92fb168a7b. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:37:13.205353 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d41c5da5-79c8-48bc-b3c7-2c85fa2fd11c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Going to run 1 instances... {{(pid=117831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 10:37:13.207666 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d41c5da5-79c8-48bc-b3c7-2c85fa2fd11c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6163bb7c-dfd7-4fb1-a3cb-9f4818243f78',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 10:37:13.255735 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d41c5da5-79c8-48bc-b3c7-2c85fa2fd11c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558052 Aug 05 10:37:13.256394 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 550/1126] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 10:37:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 10:37:13.268607 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d90057a8-cd3b-4115-a7e2-3b28da312241 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:37:13.269203 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d90057a8-cd3b-4115-a7e2-3b28da312241 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:37:13.271709 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:37:13.272381 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:37:13.332892 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d90057a8-cd3b-4115-a7e2-3b28da312241 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:37:13.339645 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d90057a8-cd3b-4115-a7e2-3b28da312241 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1219 microversion: 2.1 time: 0.075849 Aug 05 10:37:13.340235 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 577/1127] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:37:13 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:37:14.364214 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-e018ab48-400d-4e68-ae07-aa128ac09300 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:37:14.364841 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-e018ab48-400d-4e68-ae07-aa128ac09300 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:37:14.374142 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e018ab48-400d-4e68-ae07-aa128ac09300 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:14.374784 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e018ab48-400d-4e68-ae07-aa128ac09300 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:14.375435 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e018ab48-400d-4e68-ae07-aa128ac09300 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:14.376419 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e018ab48-400d-4e68-ae07-aa128ac09300 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:14.377144 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e018ab48-400d-4e68-ae07-aa128ac09300 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:14.377503 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e018ab48-400d-4e68-ae07-aa128ac09300 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:14.440164 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e018ab48-400d-4e68-ae07-aa128ac09300 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:37:14.448401 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-e018ab48-400d-4e68-ae07-aa128ac09300 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1271 microversion: 2.1 time: 0.090721 Aug 05 10:37:14.448961 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 551/1128] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:37:14 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:37:15.475219 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ba8b5cb6-6f86-41de-b841-464595b63c18 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:37:15.476241 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ba8b5cb6-6f86-41de-b841-464595b63c18 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:37:15.487152 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba8b5cb6-6f86-41de-b841-464595b63c18 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:15.487723 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba8b5cb6-6f86-41de-b841-464595b63c18 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:15.488155 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba8b5cb6-6f86-41de-b841-464595b63c18 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:15.488846 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba8b5cb6-6f86-41de-b841-464595b63c18 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:15.489290 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba8b5cb6-6f86-41de-b841-464595b63c18 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:15.489702 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba8b5cb6-6f86-41de-b841-464595b63c18 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:15.553729 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ba8b5cb6-6f86-41de-b841-464595b63c18 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:37:15.561997 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ba8b5cb6-6f86-41de-b841-464595b63c18 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1271 microversion: 2.1 time: 0.094961 Aug 05 10:37:15.562553 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 578/1129] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:37:15 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1271 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:37:16.583580 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ab08956a-a339-493e-84fe-5c06fb866fdf tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:37:16.584207 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-ab08956a-a339-493e-84fe-5c06fb866fdf tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:37:16.590942 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ab08956a-a339-493e-84fe-5c06fb866fdf tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:16.591533 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ab08956a-a339-493e-84fe-5c06fb866fdf tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:16.591968 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ab08956a-a339-493e-84fe-5c06fb866fdf tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:16.592679 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ab08956a-a339-493e-84fe-5c06fb866fdf tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:16.593134 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ab08956a-a339-493e-84fe-5c06fb866fdf tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:16.593561 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ab08956a-a339-493e-84fe-5c06fb866fdf tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:16.670035 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ab08956a-a339-493e-84fe-5c06fb866fdf tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:37:16.681029 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ab08956a-a339-493e-84fe-5c06fb866fdf tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1271 microversion: 2.1 time: 0.101506 Aug 05 10:37:16.681877 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 552/1130] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:37:16 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:37:17.705151 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-49642738-5657-4570-b7da-2af3c8db2f0c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:37:17.705759 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-49642738-5657-4570-b7da-2af3c8db2f0c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:37:17.713244 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-49642738-5657-4570-b7da-2af3c8db2f0c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:17.713712 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-49642738-5657-4570-b7da-2af3c8db2f0c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:17.714138 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-49642738-5657-4570-b7da-2af3c8db2f0c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:17.714830 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-49642738-5657-4570-b7da-2af3c8db2f0c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:17.715340 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-49642738-5657-4570-b7da-2af3c8db2f0c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:17.715759 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-49642738-5657-4570-b7da-2af3c8db2f0c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:17.779101 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-49642738-5657-4570-b7da-2af3c8db2f0c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:37:17.786985 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-49642738-5657-4570-b7da-2af3c8db2f0c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1277 microversion: 2.1 time: 0.085912 Aug 05 10:37:17.787542 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 579/1131] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:37:17 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1277 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:37:18.807791 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d5601f8c-de38-4897-820f-94609b7efd2a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:37:18.808527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d5601f8c-de38-4897-820f-94609b7efd2a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:37:18.815344 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d5601f8c-de38-4897-820f-94609b7efd2a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:18.815927 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d5601f8c-de38-4897-820f-94609b7efd2a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:18.816360 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d5601f8c-de38-4897-820f-94609b7efd2a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:18.817074 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d5601f8c-de38-4897-820f-94609b7efd2a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:18.817526 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d5601f8c-de38-4897-820f-94609b7efd2a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:18.817948 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d5601f8c-de38-4897-820f-94609b7efd2a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:18.955730 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-3c73d78c-3417-4e39-9343-2c2f724430e1 req-2206467b-599b-428e-af59-ecdfd179ff49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db0913eb-a1ef-4529-87c9-50714d985f57", "tag": "229922ab-edf0-4fae-ae9b-273c59d4d24e"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:37:18.960794 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d5601f8c-de38-4897-820f-94609b7efd2a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:37:18.966102 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-3c73d78c-3417-4e39-9343-2c2f724430e1 req-2206467b-599b-428e-af59-ecdfd179ff49 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:18.966580 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-3c73d78c-3417-4e39-9343-2c2f724430e1 req-2206467b-599b-428e-af59-ecdfd179ff49 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:18.967058 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-3c73d78c-3417-4e39-9343-2c2f724430e1 req-2206467b-599b-428e-af59-ecdfd179ff49 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:18.968571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d5601f8c-de38-4897-820f-94609b7efd2a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1319 microversion: 2.1 time: 0.164722 Aug 05 10:37:18.969137 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 553/1132] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:37:18 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:37:18.979773 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-3c73d78c-3417-4e39-9343-2c2f724430e1 req-2206467b-599b-428e-af59-ecdfd179ff49 service nova] Creating event network-changed:229922ab-edf0-4fae-ae9b-273c59d4d24e for instance db0913eb-a1ef-4529-87c9-50714d985f57 on hv-cinder-81558 Aug 05 10:37:18.984800 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-3c73d78c-3417-4e39-9343-2c2f724430e1 req-2206467b-599b-428e-af59-ecdfd179ff49 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161005 Aug 05 10:37:18.985436 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 580/1133] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:37:19.993949 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-94489206-fdc1-4975-9080-22bee5ce34d2 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:37:19.994954 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-94489206-fdc1-4975-9080-22bee5ce34d2 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:37:20.006127 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-94489206-fdc1-4975-9080-22bee5ce34d2 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:20.006925 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-94489206-fdc1-4975-9080-22bee5ce34d2 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:20.007719 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-94489206-fdc1-4975-9080-22bee5ce34d2 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:20.008850 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-94489206-fdc1-4975-9080-22bee5ce34d2 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:20.009590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-94489206-fdc1-4975-9080-22bee5ce34d2 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:20.010284 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-94489206-fdc1-4975-9080-22bee5ce34d2 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:20.152395 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-94489206-fdc1-4975-9080-22bee5ce34d2 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:37:20.162023 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-94489206-fdc1-4975-9080-22bee5ce34d2 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1319 microversion: 2.1 time: 0.174803 Aug 05 10:37:20.162639 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 554/1134] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:37:19 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:37:21.184102 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-594a4472-1fa4-4c43-951f-4a67276febec tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:37:21.184826 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-594a4472-1fa4-4c43-951f-4a67276febec tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:37:21.192064 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-594a4472-1fa4-4c43-951f-4a67276febec tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:21.192552 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-594a4472-1fa4-4c43-951f-4a67276febec tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:21.192988 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-594a4472-1fa4-4c43-951f-4a67276febec tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:21.193684 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-594a4472-1fa4-4c43-951f-4a67276febec tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:21.194137 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-594a4472-1fa4-4c43-951f-4a67276febec tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:21.194558 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-594a4472-1fa4-4c43-951f-4a67276febec tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:21.340186 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-594a4472-1fa4-4c43-951f-4a67276febec tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:37:21.348674 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-594a4472-1fa4-4c43-951f-4a67276febec tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1319 microversion: 2.1 time: 0.169423 Aug 05 10:37:21.349216 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 581/1135] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:37:21 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:37:22.369938 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-1b774ad8-900c-4461-b66d-e03f0894b874 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:37:22.370529 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-1b774ad8-900c-4461-b66d-e03f0894b874 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:37:22.377728 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1b774ad8-900c-4461-b66d-e03f0894b874 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:22.378218 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1b774ad8-900c-4461-b66d-e03f0894b874 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:22.378624 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1b774ad8-900c-4461-b66d-e03f0894b874 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:22.379397 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1b774ad8-900c-4461-b66d-e03f0894b874 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:22.379934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1b774ad8-900c-4461-b66d-e03f0894b874 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:22.380356 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-1b774ad8-900c-4461-b66d-e03f0894b874 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:22.745929 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-1b774ad8-900c-4461-b66d-e03f0894b874 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:37:22.754140 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-1b774ad8-900c-4461-b66d-e03f0894b874 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1319 microversion: 2.1 time: 0.387900 Aug 05 10:37:22.754715 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 555/1136] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:37:22 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1319 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:37:23.775285 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c9f8d917-3638-441d-a13e-0fe33936028b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:37:23.775888 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c9f8d917-3638-441d-a13e-0fe33936028b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:37:23.778395 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:37:23.783483 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c9f8d917-3638-441d-a13e-0fe33936028b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:23.783957 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c9f8d917-3638-441d-a13e-0fe33936028b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:23.784381 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c9f8d917-3638-441d-a13e-0fe33936028b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:23.785147 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c9f8d917-3638-441d-a13e-0fe33936028b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:23.785811 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c9f8d917-3638-441d-a13e-0fe33936028b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:23.786328 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c9f8d917-3638-441d-a13e-0fe33936028b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:23.926371 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c9f8d917-3638-441d-a13e-0fe33936028b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:37:23.936821 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c9f8d917-3638-441d-a13e-0fe33936028b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1319 microversion: 2.1 time: 0.165543 Aug 05 10:37:23.937518 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 582/1137] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:37:23 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:37:24.960520 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b6c8e401-72f6-4814-bddc-4403d57d6b2a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:37:24.962134 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b6c8e401-72f6-4814-bddc-4403d57d6b2a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:37:24.963672 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=2 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:37:24.964347 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=6 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:37:24.970682 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b6c8e401-72f6-4814-bddc-4403d57d6b2a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:24.971196 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b6c8e401-72f6-4814-bddc-4403d57d6b2a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:24.971631 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b6c8e401-72f6-4814-bddc-4403d57d6b2a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:24.972366 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b6c8e401-72f6-4814-bddc-4403d57d6b2a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:24.972823 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b6c8e401-72f6-4814-bddc-4403d57d6b2a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:24.973452 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b6c8e401-72f6-4814-bddc-4403d57d6b2a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:25.117946 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b6c8e401-72f6-4814-bddc-4403d57d6b2a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:37:25.125419 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b6c8e401-72f6-4814-bddc-4403d57d6b2a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1319 microversion: 2.1 time: 0.168942 Aug 05 10:37:25.125990 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 556/1138] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:37:24 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:37:26.146372 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-04593bb1-7139-4459-8443-a214209cccdf tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:37:26.146998 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-04593bb1-7139-4459-8443-a214209cccdf tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:37:26.153631 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-04593bb1-7139-4459-8443-a214209cccdf tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:26.154194 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-04593bb1-7139-4459-8443-a214209cccdf tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:26.154632 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-04593bb1-7139-4459-8443-a214209cccdf tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:26.155359 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-04593bb1-7139-4459-8443-a214209cccdf tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:26.155845 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-04593bb1-7139-4459-8443-a214209cccdf tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:26.156270 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-04593bb1-7139-4459-8443-a214209cccdf tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:26.304886 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-04593bb1-7139-4459-8443-a214209cccdf tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:37:26.316034 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-04593bb1-7139-4459-8443-a214209cccdf tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1319 microversion: 2.1 time: 0.173795 Aug 05 10:37:26.316635 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 583/1139] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:37:26 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:37:27.343494 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d5e7d549-931c-46c5-8bd2-b749fad93ca3 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:37:27.344085 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d5e7d549-931c-46c5-8bd2-b749fad93ca3 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:37:27.354969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d5e7d549-931c-46c5-8bd2-b749fad93ca3 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:27.355648 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d5e7d549-931c-46c5-8bd2-b749fad93ca3 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:27.356229 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d5e7d549-931c-46c5-8bd2-b749fad93ca3 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:27.357207 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d5e7d549-931c-46c5-8bd2-b749fad93ca3 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:27.357808 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d5e7d549-931c-46c5-8bd2-b749fad93ca3 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:27.358337 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d5e7d549-931c-46c5-8bd2-b749fad93ca3 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:27.499664 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d5e7d549-931c-46c5-8bd2-b749fad93ca3 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:37:27.512535 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d5e7d549-931c-46c5-8bd2-b749fad93ca3 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1319 microversion: 2.1 time: 0.172776 Aug 05 10:37:27.513305 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 557/1140] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:37:27 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:37:28.540695 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0aa6844c-56b3-4711-b07e-47f4ff09076f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:37:28.541432 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0aa6844c-56b3-4711-b07e-47f4ff09076f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:37:28.549605 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0aa6844c-56b3-4711-b07e-47f4ff09076f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:28.550165 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0aa6844c-56b3-4711-b07e-47f4ff09076f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:28.550677 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0aa6844c-56b3-4711-b07e-47f4ff09076f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:28.551529 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0aa6844c-56b3-4711-b07e-47f4ff09076f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:28.552646 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0aa6844c-56b3-4711-b07e-47f4ff09076f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:28.553180 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0aa6844c-56b3-4711-b07e-47f4ff09076f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:28.700928 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0aa6844c-56b3-4711-b07e-47f4ff09076f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:37:28.712703 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0aa6844c-56b3-4711-b07e-47f4ff09076f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1319 microversion: 2.1 time: 0.178092 Aug 05 10:37:28.713368 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 584/1141] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:37:28 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:37:29.741979 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-7209e0fc-b3cc-40dd-b371-6726d476b0c3 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:37:29.742711 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-7209e0fc-b3cc-40dd-b371-6726d476b0c3 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:37:29.750795 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7209e0fc-b3cc-40dd-b371-6726d476b0c3 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:29.751388 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7209e0fc-b3cc-40dd-b371-6726d476b0c3 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:29.751890 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7209e0fc-b3cc-40dd-b371-6726d476b0c3 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:29.752661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7209e0fc-b3cc-40dd-b371-6726d476b0c3 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:29.753216 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7209e0fc-b3cc-40dd-b371-6726d476b0c3 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:29.753703 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7209e0fc-b3cc-40dd-b371-6726d476b0c3 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:29.904681 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-7209e0fc-b3cc-40dd-b371-6726d476b0c3 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:37:29.907750 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-7209e0fc-b3cc-40dd-b371-6726d476b0c3 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1319 microversion: 2.1 time: 0.171924 Aug 05 10:37:29.908583 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 558/1142] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:37:29 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:37:30.934855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9c43dd33-c6d9-48b7-9b28-a093582ab2dd tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:37:30.935854 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9c43dd33-c6d9-48b7-9b28-a093582ab2dd tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:37:30.945322 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9c43dd33-c6d9-48b7-9b28-a093582ab2dd tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:30.945802 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9c43dd33-c6d9-48b7-9b28-a093582ab2dd tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:30.946232 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9c43dd33-c6d9-48b7-9b28-a093582ab2dd tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:30.946915 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9c43dd33-c6d9-48b7-9b28-a093582ab2dd tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:30.947393 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9c43dd33-c6d9-48b7-9b28-a093582ab2dd tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:30.947813 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9c43dd33-c6d9-48b7-9b28-a093582ab2dd tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:31.088879 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9c43dd33-c6d9-48b7-9b28-a093582ab2dd tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:37:31.096786 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9c43dd33-c6d9-48b7-9b28-a093582ab2dd tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1319 microversion: 2.1 time: 0.168486 Aug 05 10:37:31.097350 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 585/1143] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:37:30 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:37:31.689895 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-fce83182-51cd-43bb-8224-b5f148be35bd req-56698814-f90f-430d-8821-f20e0ed3f26d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0913eb-a1ef-4529-87c9-50714d985f57", "name": "network-vif-plugged", "status": "completed", "tag": "229922ab-edf0-4fae-ae9b-273c59d4d24e"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:37:31.702691 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-fce83182-51cd-43bb-8224-b5f148be35bd req-56698814-f90f-430d-8821-f20e0ed3f26d service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:31.703166 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-fce83182-51cd-43bb-8224-b5f148be35bd req-56698814-f90f-430d-8821-f20e0ed3f26d service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:31.703592 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-fce83182-51cd-43bb-8224-b5f148be35bd req-56698814-f90f-430d-8821-f20e0ed3f26d service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:31.716284 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-fce83182-51cd-43bb-8224-b5f148be35bd req-56698814-f90f-430d-8821-f20e0ed3f26d service nova] Creating event network-vif-plugged:229922ab-edf0-4fae-ae9b-273c59d4d24e for instance db0913eb-a1ef-4529-87c9-50714d985f57 on hv-cinder-81558 Aug 05 10:37:31.721972 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-fce83182-51cd-43bb-8224-b5f148be35bd req-56698814-f90f-430d-8821-f20e0ed3f26d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132915 Aug 05 10:37:31.722587 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 559/1144] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:37:32.119287 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-670c1a31-5139-4b48-ab17-be9347b29a57 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:37:32.119983 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-670c1a31-5139-4b48-ab17-be9347b29a57 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:37:32.129931 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-670c1a31-5139-4b48-ab17-be9347b29a57 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:32.130469 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-670c1a31-5139-4b48-ab17-be9347b29a57 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:32.131049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-670c1a31-5139-4b48-ab17-be9347b29a57 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:32.131756 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-670c1a31-5139-4b48-ab17-be9347b29a57 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:32.132205 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-670c1a31-5139-4b48-ab17-be9347b29a57 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:32.132596 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-670c1a31-5139-4b48-ab17-be9347b29a57 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:32.277698 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-670c1a31-5139-4b48-ab17-be9347b29a57 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:37:32.289497 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-670c1a31-5139-4b48-ab17-be9347b29a57 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1319 microversion: 2.1 time: 0.174391 Aug 05 10:37:32.290078 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 586/1145] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:37:32 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:37:33.314867 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f9109eaf-06e9-4d67-9286-8183c016030c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:37:33.315611 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f9109eaf-06e9-4d67-9286-8183c016030c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:37:33.322518 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f9109eaf-06e9-4d67-9286-8183c016030c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:33.323013 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f9109eaf-06e9-4d67-9286-8183c016030c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:33.323448 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f9109eaf-06e9-4d67-9286-8183c016030c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:33.324146 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f9109eaf-06e9-4d67-9286-8183c016030c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:33.324602 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f9109eaf-06e9-4d67-9286-8183c016030c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:33.325024 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f9109eaf-06e9-4d67-9286-8183c016030c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:33.463473 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-f9109eaf-06e9-4d67-9286-8183c016030c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:37:33.474941 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f9109eaf-06e9-4d67-9286-8183c016030c tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1319 microversion: 2.1 time: 0.164536 Aug 05 10:37:33.475710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 560/1146] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:37:33 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:37:34.504972 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4f5341b3-fa52-45db-8725-d2bfe37bae14 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:37:34.505882 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4f5341b3-fa52-45db-8725-d2bfe37bae14 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:37:34.513328 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f5341b3-fa52-45db-8725-d2bfe37bae14 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:34.513810 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f5341b3-fa52-45db-8725-d2bfe37bae14 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:34.514249 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f5341b3-fa52-45db-8725-d2bfe37bae14 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:34.514943 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f5341b3-fa52-45db-8725-d2bfe37bae14 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:34.515411 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f5341b3-fa52-45db-8725-d2bfe37bae14 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:34.515830 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4f5341b3-fa52-45db-8725-d2bfe37bae14 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:34.657283 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4f5341b3-fa52-45db-8725-d2bfe37bae14 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:37:34.665270 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4f5341b3-fa52-45db-8725-d2bfe37bae14 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1319 microversion: 2.1 time: 0.166820 Aug 05 10:37:34.665834 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 587/1147] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:37:34 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:37:35.690246 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-bd0546ff-b415-49df-98fa-6e7022ff8c20 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:37:35.691289 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-bd0546ff-b415-49df-98fa-6e7022ff8c20 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:37:35.702627 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bd0546ff-b415-49df-98fa-6e7022ff8c20 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:35.703464 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bd0546ff-b415-49df-98fa-6e7022ff8c20 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:35.704180 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bd0546ff-b415-49df-98fa-6e7022ff8c20 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:35.705309 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bd0546ff-b415-49df-98fa-6e7022ff8c20 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:35.706053 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bd0546ff-b415-49df-98fa-6e7022ff8c20 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:35.706749 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-bd0546ff-b415-49df-98fa-6e7022ff8c20 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:35.845375 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-bd0546ff-b415-49df-98fa-6e7022ff8c20 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:37:35.853495 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-bd0546ff-b415-49df-98fa-6e7022ff8c20 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1319 microversion: 2.1 time: 0.169744 Aug 05 10:37:35.854053 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 561/1148] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:37:35 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:37:36.874480 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e3096466-2dca-4937-9cae-f6aa1216b90d tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:37:36.875309 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e3096466-2dca-4937-9cae-f6aa1216b90d tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:37:36.884154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3096466-2dca-4937-9cae-f6aa1216b90d tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:36.888447 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3096466-2dca-4937-9cae-f6aa1216b90d tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:36.888890 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3096466-2dca-4937-9cae-f6aa1216b90d tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:36.889613 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3096466-2dca-4937-9cae-f6aa1216b90d tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:36.890067 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3096466-2dca-4937-9cae-f6aa1216b90d tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:36.890489 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e3096466-2dca-4937-9cae-f6aa1216b90d tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:37.029445 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e3096466-2dca-4937-9cae-f6aa1216b90d tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:37:37.037824 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e3096466-2dca-4937-9cae-f6aa1216b90d tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1319 microversion: 2.1 time: 0.167540 Aug 05 10:37:37.038441 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 588/1149] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:37:36 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:37:38.065362 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-950bc575-a6ff-4c4e-9047-2d3bd21d6664 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:37:38.066145 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-950bc575-a6ff-4c4e-9047-2d3bd21d6664 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:37:38.073543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-950bc575-a6ff-4c4e-9047-2d3bd21d6664 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:38.074108 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-950bc575-a6ff-4c4e-9047-2d3bd21d6664 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:38.074722 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-950bc575-a6ff-4c4e-9047-2d3bd21d6664 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:38.075695 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-950bc575-a6ff-4c4e-9047-2d3bd21d6664 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:37:38.076240 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-950bc575-a6ff-4c4e-9047-2d3bd21d6664 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:37:38.076671 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-950bc575-a6ff-4c4e-9047-2d3bd21d6664 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:37:38.211115 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-950bc575-a6ff-4c4e-9047-2d3bd21d6664 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:37:38.219154 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-950bc575-a6ff-4c4e-9047-2d3bd21d6664 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1508 microversion: 2.1 time: 0.157650 Aug 05 10:37:38.219716 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 562/1150] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:37:38 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:07.876169 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 10:38:07.876682 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Fri Aug 5 10:38:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 10:38:08.304594 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b964d3ac-1e7f-4902-a041-cb7406274516 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55217458-3659-4df8-8da3-41ac7f481177", "device": "/dev/sdb"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:38:08.308040 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b964d3ac-1e7f-4902-a041-cb7406274516 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:08.310294 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=26 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:38:08.310949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=62 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:38:08.317723 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b964d3ac-1e7f-4902-a041-cb7406274516 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:08.318217 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b964d3ac-1e7f-4902-a041-cb7406274516 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:08.318660 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b964d3ac-1e7f-4902-a041-cb7406274516 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:08.319607 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b964d3ac-1e7f-4902-a041-cb7406274516 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:08.320095 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b964d3ac-1e7f-4902-a041-cb7406274516 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:08.320465 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b964d3ac-1e7f-4902-a041-cb7406274516 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:08.601315 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b964d3ac-1e7f-4902-a041-cb7406274516 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "POST /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300517 Aug 05 10:38:08.601920 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 589/1151] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 10:38:08 2022] POST /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:38:14.851187 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f12807d7-6d97-4c1c-9641-1f33fc044c9c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-218436307", "imageRef": "6163bb7c-dfd7-4fb1-a3cb-9f4818243f78", "flavorRef": "452"}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:38:14.858216 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:38:14.858917 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=70 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:38:14.907876 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.network.neutron [None req-f12807d7-6d97-4c1c-9641-1f33fc044c9c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] validate_networks() for None {{(pid=117831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 10:38:15.205410 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-f12807d7-6d97-4c1c-9641-1f33fc044c9c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Flavor limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 10:38:15.205948 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-f12807d7-6d97-4c1c-9641-1f33fc044c9c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Image limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 10:38:15.206563 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-f12807d7-6d97-4c1c-9641-1f33fc044c9c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Flavor pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 10:38:15.207232 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-f12807d7-6d97-4c1c-9641-1f33fc044c9c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Image pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 10:38:15.207861 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-f12807d7-6d97-4c1c-9641-1f33fc044c9c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 10:38:15.222233 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f12807d7-6d97-4c1c-9641-1f33fc044c9c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:15.222705 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f12807d7-6d97-4c1c-9641-1f33fc044c9c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:15.223167 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f12807d7-6d97-4c1c-9641-1f33fc044c9c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:15.223889 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f12807d7-6d97-4c1c-9641-1f33fc044c9c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:15.224333 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f12807d7-6d97-4c1c-9641-1f33fc044c9c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:15.224752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f12807d7-6d97-4c1c-9641-1f33fc044c9c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:15.241339 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-f12807d7-6d97-4c1c-9641-1f33fc044c9c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Getting quotas for project 3977bfbc156b44c7a7ba0c273708b2b1. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:38:15.245272 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-f12807d7-6d97-4c1c-9641-1f33fc044c9c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Getting quotas for user 20886161e1f34eedbea38b1ac7efed50 and project 3977bfbc156b44c7a7ba0c273708b2b1. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:38:15.256198 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f12807d7-6d97-4c1c-9641-1f33fc044c9c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Going to run 1 instances... {{(pid=117831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 10:38:15.258438 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f12807d7-6d97-4c1c-9641-1f33fc044c9c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6163bb7c-dfd7-4fb1-a3cb-9f4818243f78',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 10:38:15.304350 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f12807d7-6d97-4c1c-9641-1f33fc044c9c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.457311 Aug 05 10:38:15.305036 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 563/1152] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 10:38:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 10:38:15.316270 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e132d444-4d36-48e4-8573-0f8ce0e01c72 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:15.317013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e132d444-4d36-48e4-8573-0f8ce0e01c72 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:15.380103 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e132d444-4d36-48e4-8573-0f8ce0e01c72 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20886161e1f34eedbea38b1ac7efed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977bfbc156b44c7a7ba0c273708b2b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:15.387703 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e132d444-4d36-48e4-8573-0f8ce0e01c72 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 200 len: 1214 microversion: 2.1 time: 0.075736 Aug 05 10:38:15.388242 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 590/1153] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:15 2022] GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:16.409496 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-394233a9-7b16-44c0-962f-cf42cb6e1692 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:16.410201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-394233a9-7b16-44c0-962f-cf42cb6e1692 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:16.417325 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-394233a9-7b16-44c0-962f-cf42cb6e1692 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:16.417881 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-394233a9-7b16-44c0-962f-cf42cb6e1692 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:16.418382 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-394233a9-7b16-44c0-962f-cf42cb6e1692 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:16.419194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-394233a9-7b16-44c0-962f-cf42cb6e1692 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:16.419709 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-394233a9-7b16-44c0-962f-cf42cb6e1692 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:16.420194 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-394233a9-7b16-44c0-962f-cf42cb6e1692 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:16.484196 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-394233a9-7b16-44c0-962f-cf42cb6e1692 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20886161e1f34eedbea38b1ac7efed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977bfbc156b44c7a7ba0c273708b2b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:16.493283 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-394233a9-7b16-44c0-962f-cf42cb6e1692 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 200 len: 1266 microversion: 2.1 time: 0.088891 Aug 05 10:38:16.494576 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 564/1154] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:16 2022] GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:17.516408 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ba4261b5-9f77-4716-bc28-c1f18fd55f67 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:17.517009 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ba4261b5-9f77-4716-bc28-c1f18fd55f67 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:17.525049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba4261b5-9f77-4716-bc28-c1f18fd55f67 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:17.525441 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba4261b5-9f77-4716-bc28-c1f18fd55f67 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:17.525870 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba4261b5-9f77-4716-bc28-c1f18fd55f67 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:17.526569 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba4261b5-9f77-4716-bc28-c1f18fd55f67 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:17.527030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba4261b5-9f77-4716-bc28-c1f18fd55f67 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:17.527447 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba4261b5-9f77-4716-bc28-c1f18fd55f67 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:17.667843 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ba4261b5-9f77-4716-bc28-c1f18fd55f67 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20886161e1f34eedbea38b1ac7efed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977bfbc156b44c7a7ba0c273708b2b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:17.680064 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ba4261b5-9f77-4716-bc28-c1f18fd55f67 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 200 len: 1314 microversion: 2.1 time: 0.167335 Aug 05 10:38:17.680930 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 591/1155] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:17 2022] GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:18.716551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c6c586f9-8fce-4d69-87d2-65c6d69d3414 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:18.717283 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c6c586f9-8fce-4d69-87d2-65c6d69d3414 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:18.726022 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6c586f9-8fce-4d69-87d2-65c6d69d3414 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:18.726498 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6c586f9-8fce-4d69-87d2-65c6d69d3414 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:18.726928 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6c586f9-8fce-4d69-87d2-65c6d69d3414 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:18.727656 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6c586f9-8fce-4d69-87d2-65c6d69d3414 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:18.728080 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6c586f9-8fce-4d69-87d2-65c6d69d3414 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:18.728519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c6c586f9-8fce-4d69-87d2-65c6d69d3414 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:18.864713 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c6c586f9-8fce-4d69-87d2-65c6d69d3414 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20886161e1f34eedbea38b1ac7efed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977bfbc156b44c7a7ba0c273708b2b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:18.872884 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c6c586f9-8fce-4d69-87d2-65c6d69d3414 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 200 len: 1314 microversion: 2.1 time: 0.162664 Aug 05 10:38:18.873420 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 565/1156] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:18 2022] GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:19.462460 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-85dfc9a1-1053-477c-bce3-5bfbb6de7444 req-d69d4584-deab-4666-8edd-e23674660882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da7c54c9-788f-4a7b-b033-71f677f48bda", "tag": "cc27fd4d-44c7-42db-8777-39865c07246d"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:38:19.472777 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-85dfc9a1-1053-477c-bce3-5bfbb6de7444 req-d69d4584-deab-4666-8edd-e23674660882 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:19.473317 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-85dfc9a1-1053-477c-bce3-5bfbb6de7444 req-d69d4584-deab-4666-8edd-e23674660882 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:19.473816 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-85dfc9a1-1053-477c-bce3-5bfbb6de7444 req-d69d4584-deab-4666-8edd-e23674660882 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:19.485000 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-85dfc9a1-1053-477c-bce3-5bfbb6de7444 req-d69d4584-deab-4666-8edd-e23674660882 service nova] Creating event network-changed:cc27fd4d-44c7-42db-8777-39865c07246d for instance da7c54c9-788f-4a7b-b033-71f677f48bda on hv-cinder-81558 Aug 05 10:38:19.490107 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-85dfc9a1-1053-477c-bce3-5bfbb6de7444 req-d69d4584-deab-4666-8edd-e23674660882 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031394 Aug 05 10:38:19.490650 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 592/1157] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:38:19.899755 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-9f91c6ab-b169-454e-a091-840d7cda47f9 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:19.900693 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-9f91c6ab-b169-454e-a091-840d7cda47f9 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:19.912015 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9f91c6ab-b169-454e-a091-840d7cda47f9 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:19.912812 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9f91c6ab-b169-454e-a091-840d7cda47f9 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:19.913531 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9f91c6ab-b169-454e-a091-840d7cda47f9 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:19.914669 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9f91c6ab-b169-454e-a091-840d7cda47f9 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:19.915474 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9f91c6ab-b169-454e-a091-840d7cda47f9 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:19.916178 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-9f91c6ab-b169-454e-a091-840d7cda47f9 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:20.049510 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-9f91c6ab-b169-454e-a091-840d7cda47f9 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20886161e1f34eedbea38b1ac7efed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977bfbc156b44c7a7ba0c273708b2b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:20.057268 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-9f91c6ab-b169-454e-a091-840d7cda47f9 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 200 len: 1314 microversion: 2.1 time: 0.164447 Aug 05 10:38:20.057830 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 566/1158] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:19 2022] GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:21.079353 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-17e7ea26-7491-499d-82ef-56ac8011f647 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:21.079935 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-17e7ea26-7491-499d-82ef-56ac8011f647 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:21.086675 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17e7ea26-7491-499d-82ef-56ac8011f647 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:21.087188 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17e7ea26-7491-499d-82ef-56ac8011f647 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:21.087611 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17e7ea26-7491-499d-82ef-56ac8011f647 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:21.088292 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17e7ea26-7491-499d-82ef-56ac8011f647 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:21.088731 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17e7ea26-7491-499d-82ef-56ac8011f647 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:21.089147 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17e7ea26-7491-499d-82ef-56ac8011f647 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:21.226336 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-17e7ea26-7491-499d-82ef-56ac8011f647 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20886161e1f34eedbea38b1ac7efed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977bfbc156b44c7a7ba0c273708b2b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:21.233881 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-17e7ea26-7491-499d-82ef-56ac8011f647 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 200 len: 1314 microversion: 2.1 time: 0.159481 Aug 05 10:38:21.234438 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 593/1159] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:21 2022] GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:22.255249 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-32c6e358-f6a7-4a1b-9424-09658f85aec8 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:22.255887 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-32c6e358-f6a7-4a1b-9424-09658f85aec8 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:22.262547 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-32c6e358-f6a7-4a1b-9424-09658f85aec8 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:22.263052 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-32c6e358-f6a7-4a1b-9424-09658f85aec8 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:22.263485 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-32c6e358-f6a7-4a1b-9424-09658f85aec8 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:22.264175 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-32c6e358-f6a7-4a1b-9424-09658f85aec8 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:22.264626 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-32c6e358-f6a7-4a1b-9424-09658f85aec8 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:22.265044 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-32c6e358-f6a7-4a1b-9424-09658f85aec8 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:22.407324 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-32c6e358-f6a7-4a1b-9424-09658f85aec8 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20886161e1f34eedbea38b1ac7efed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977bfbc156b44c7a7ba0c273708b2b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:22.415993 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-32c6e358-f6a7-4a1b-9424-09658f85aec8 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 200 len: 1314 microversion: 2.1 time: 0.164859 Aug 05 10:38:22.416491 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 567/1160] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:22 2022] GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:23.441109 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-de584f47-2851-41d6-8388-97ee35d96295 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:23.442331 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-de584f47-2851-41d6-8388-97ee35d96295 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:23.449004 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-de584f47-2851-41d6-8388-97ee35d96295 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:23.449508 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-de584f47-2851-41d6-8388-97ee35d96295 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:23.449934 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-de584f47-2851-41d6-8388-97ee35d96295 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:23.450619 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-de584f47-2851-41d6-8388-97ee35d96295 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:23.451104 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-de584f47-2851-41d6-8388-97ee35d96295 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:23.451523 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-de584f47-2851-41d6-8388-97ee35d96295 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:23.605272 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-de584f47-2851-41d6-8388-97ee35d96295 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20886161e1f34eedbea38b1ac7efed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977bfbc156b44c7a7ba0c273708b2b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:23.613579 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-de584f47-2851-41d6-8388-97ee35d96295 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 200 len: 1314 microversion: 2.1 time: 0.179078 Aug 05 10:38:23.614147 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 594/1161] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:23 2022] GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:24.638322 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-69603071-84af-4c3a-8846-b098edba2d09 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:24.639367 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-69603071-84af-4c3a-8846-b098edba2d09 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:24.650300 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-69603071-84af-4c3a-8846-b098edba2d09 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:24.651174 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-69603071-84af-4c3a-8846-b098edba2d09 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:24.651899 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-69603071-84af-4c3a-8846-b098edba2d09 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:24.653046 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-69603071-84af-4c3a-8846-b098edba2d09 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:24.653802 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-69603071-84af-4c3a-8846-b098edba2d09 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:24.654513 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-69603071-84af-4c3a-8846-b098edba2d09 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:24.797820 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-69603071-84af-4c3a-8846-b098edba2d09 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20886161e1f34eedbea38b1ac7efed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977bfbc156b44c7a7ba0c273708b2b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:24.805740 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-69603071-84af-4c3a-8846-b098edba2d09 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 200 len: 1314 microversion: 2.1 time: 0.174113 Aug 05 10:38:24.806000 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 568/1162] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:24 2022] GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:25.828338 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a51c8c7c-b359-4699-8b91-fed33f70e1da tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:25.829039 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a51c8c7c-b359-4699-8b91-fed33f70e1da tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:25.832304 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:38:25.840628 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a51c8c7c-b359-4699-8b91-fed33f70e1da tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:25.841214 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a51c8c7c-b359-4699-8b91-fed33f70e1da tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:25.841701 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a51c8c7c-b359-4699-8b91-fed33f70e1da tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:25.842584 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a51c8c7c-b359-4699-8b91-fed33f70e1da tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:25.843105 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a51c8c7c-b359-4699-8b91-fed33f70e1da tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:25.843554 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a51c8c7c-b359-4699-8b91-fed33f70e1da tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:25.984513 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a51c8c7c-b359-4699-8b91-fed33f70e1da tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20886161e1f34eedbea38b1ac7efed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977bfbc156b44c7a7ba0c273708b2b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:25.994034 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a51c8c7c-b359-4699-8b91-fed33f70e1da tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 200 len: 1314 microversion: 2.1 time: 0.171901 Aug 05 10:38:25.994641 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 595/1163] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:25 2022] GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:27.015898 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-97479f33-8c83-4475-a2b9-07b4bc76f8c1 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:27.016744 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-97479f33-8c83-4475-a2b9-07b4bc76f8c1 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:27.018570 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=2 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:38:27.019261 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=6 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:38:27.025495 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-97479f33-8c83-4475-a2b9-07b4bc76f8c1 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:27.025986 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-97479f33-8c83-4475-a2b9-07b4bc76f8c1 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:27.026561 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-97479f33-8c83-4475-a2b9-07b4bc76f8c1 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:27.027296 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-97479f33-8c83-4475-a2b9-07b4bc76f8c1 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:27.027757 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-97479f33-8c83-4475-a2b9-07b4bc76f8c1 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:27.028185 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-97479f33-8c83-4475-a2b9-07b4bc76f8c1 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:27.173571 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-97479f33-8c83-4475-a2b9-07b4bc76f8c1 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20886161e1f34eedbea38b1ac7efed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977bfbc156b44c7a7ba0c273708b2b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:27.181369 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-97479f33-8c83-4475-a2b9-07b4bc76f8c1 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 200 len: 1314 microversion: 2.1 time: 0.169491 Aug 05 10:38:27.181932 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 569/1164] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:27 2022] GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:28.204166 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-df98d0b8-08e9-4e34-ab94-c5c9784b61c2 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:28.204779 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-df98d0b8-08e9-4e34-ab94-c5c9784b61c2 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:28.211855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df98d0b8-08e9-4e34-ab94-c5c9784b61c2 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:28.212326 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df98d0b8-08e9-4e34-ab94-c5c9784b61c2 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:28.212751 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df98d0b8-08e9-4e34-ab94-c5c9784b61c2 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:28.213434 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df98d0b8-08e9-4e34-ab94-c5c9784b61c2 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:28.213877 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df98d0b8-08e9-4e34-ab94-c5c9784b61c2 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:28.214297 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df98d0b8-08e9-4e34-ab94-c5c9784b61c2 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:28.348406 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-df98d0b8-08e9-4e34-ab94-c5c9784b61c2 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20886161e1f34eedbea38b1ac7efed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977bfbc156b44c7a7ba0c273708b2b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:28.356700 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-df98d0b8-08e9-4e34-ab94-c5c9784b61c2 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 200 len: 1314 microversion: 2.1 time: 0.156534 Aug 05 10:38:28.357266 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 596/1165] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:28 2022] GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:29.386126 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-51a62751-ba80-47df-a8da-a6d9445fd877 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:29.386787 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-51a62751-ba80-47df-a8da-a6d9445fd877 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:29.395328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-51a62751-ba80-47df-a8da-a6d9445fd877 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:29.395900 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-51a62751-ba80-47df-a8da-a6d9445fd877 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:29.396424 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-51a62751-ba80-47df-a8da-a6d9445fd877 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:29.397248 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-51a62751-ba80-47df-a8da-a6d9445fd877 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:29.397785 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-51a62751-ba80-47df-a8da-a6d9445fd877 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:29.398289 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-51a62751-ba80-47df-a8da-a6d9445fd877 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:29.534879 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-51a62751-ba80-47df-a8da-a6d9445fd877 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20886161e1f34eedbea38b1ac7efed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977bfbc156b44c7a7ba0c273708b2b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:29.544497 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-51a62751-ba80-47df-a8da-a6d9445fd877 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 200 len: 1314 microversion: 2.1 time: 0.163594 Aug 05 10:38:29.545071 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 570/1166] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:29 2022] GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:30.568668 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2efbb7f2-f6fd-437a-abf4-852bb18e3a1e tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:30.569276 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2efbb7f2-f6fd-437a-abf4-852bb18e3a1e tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:30.576285 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2efbb7f2-f6fd-437a-abf4-852bb18e3a1e tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:30.576752 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2efbb7f2-f6fd-437a-abf4-852bb18e3a1e tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:30.577180 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2efbb7f2-f6fd-437a-abf4-852bb18e3a1e tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:30.577863 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2efbb7f2-f6fd-437a-abf4-852bb18e3a1e tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:30.578288 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2efbb7f2-f6fd-437a-abf4-852bb18e3a1e tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:30.578730 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2efbb7f2-f6fd-437a-abf4-852bb18e3a1e tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:30.719887 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2efbb7f2-f6fd-437a-abf4-852bb18e3a1e tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20886161e1f34eedbea38b1ac7efed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977bfbc156b44c7a7ba0c273708b2b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:30.727819 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2efbb7f2-f6fd-437a-abf4-852bb18e3a1e tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 200 len: 1314 microversion: 2.1 time: 0.163232 Aug 05 10:38:30.728385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 597/1167] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:30 2022] GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:31.750431 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-34e1e7f0-6acd-4759-8fd5-b508391f326e tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:31.751414 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-34e1e7f0-6acd-4759-8fd5-b508391f326e tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:31.761544 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-34e1e7f0-6acd-4759-8fd5-b508391f326e tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:31.762023 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-34e1e7f0-6acd-4759-8fd5-b508391f326e tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:31.762451 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-34e1e7f0-6acd-4759-8fd5-b508391f326e tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:31.763195 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-34e1e7f0-6acd-4759-8fd5-b508391f326e tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:31.763721 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-34e1e7f0-6acd-4759-8fd5-b508391f326e tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:31.764339 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-34e1e7f0-6acd-4759-8fd5-b508391f326e tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:31.936008 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-34e1e7f0-6acd-4759-8fd5-b508391f326e tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20886161e1f34eedbea38b1ac7efed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977bfbc156b44c7a7ba0c273708b2b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:31.945914 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-34e1e7f0-6acd-4759-8fd5-b508391f326e tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 200 len: 1314 microversion: 2.1 time: 0.200949 Aug 05 10:38:31.946469 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 571/1168] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:31 2022] GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:32.974786 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a7a06d90-ba67-4fef-a25a-4c9af263b517 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:32.975932 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a7a06d90-ba67-4fef-a25a-4c9af263b517 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:32.982726 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a7a06d90-ba67-4fef-a25a-4c9af263b517 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:32.983245 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a7a06d90-ba67-4fef-a25a-4c9af263b517 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:32.983681 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a7a06d90-ba67-4fef-a25a-4c9af263b517 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:32.984380 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a7a06d90-ba67-4fef-a25a-4c9af263b517 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:32.984830 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a7a06d90-ba67-4fef-a25a-4c9af263b517 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:32.985254 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a7a06d90-ba67-4fef-a25a-4c9af263b517 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:33.115024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a7a06d90-ba67-4fef-a25a-4c9af263b517 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20886161e1f34eedbea38b1ac7efed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977bfbc156b44c7a7ba0c273708b2b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:33.125955 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a7a06d90-ba67-4fef-a25a-4c9af263b517 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 200 len: 1314 microversion: 2.1 time: 0.157459 Aug 05 10:38:33.126506 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 598/1169] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:32 2022] GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:34.153585 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f16b42da-f63a-4849-9e95-355659df54a9 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:34.154547 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f16b42da-f63a-4849-9e95-355659df54a9 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:34.165317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f16b42da-f63a-4849-9e95-355659df54a9 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:34.166124 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f16b42da-f63a-4849-9e95-355659df54a9 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:34.166851 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f16b42da-f63a-4849-9e95-355659df54a9 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:34.168056 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f16b42da-f63a-4849-9e95-355659df54a9 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:34.169557 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f16b42da-f63a-4849-9e95-355659df54a9 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:34.169557 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f16b42da-f63a-4849-9e95-355659df54a9 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:34.319796 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-f16b42da-f63a-4849-9e95-355659df54a9 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20886161e1f34eedbea38b1ac7efed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977bfbc156b44c7a7ba0c273708b2b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:34.327631 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f16b42da-f63a-4849-9e95-355659df54a9 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 200 len: 1314 microversion: 2.1 time: 0.180783 Aug 05 10:38:34.328225 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 572/1170] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:34 2022] GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:34.419036 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-3f71779d-6006-438b-ab72-d61ae477b2f1 req-4fb38e55-aa28-4ed1-aba1-8072a98f3177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da7c54c9-788f-4a7b-b033-71f677f48bda", "name": "network-vif-plugged", "status": "completed", "tag": "cc27fd4d-44c7-42db-8777-39865c07246d"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:38:34.430556 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-3f71779d-6006-438b-ab72-d61ae477b2f1 req-4fb38e55-aa28-4ed1-aba1-8072a98f3177 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:34.431048 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-3f71779d-6006-438b-ab72-d61ae477b2f1 req-4fb38e55-aa28-4ed1-aba1-8072a98f3177 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:34.431465 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-3f71779d-6006-438b-ab72-d61ae477b2f1 req-4fb38e55-aa28-4ed1-aba1-8072a98f3177 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:34.445893 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-3f71779d-6006-438b-ab72-d61ae477b2f1 req-4fb38e55-aa28-4ed1-aba1-8072a98f3177 service nova] Creating event network-vif-plugged:cc27fd4d-44c7-42db-8777-39865c07246d for instance da7c54c9-788f-4a7b-b033-71f677f48bda on hv-cinder-81558 Aug 05 10:38:34.451182 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-3f71779d-6006-438b-ab72-d61ae477b2f1 req-4fb38e55-aa28-4ed1-aba1-8072a98f3177 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035917 Aug 05 10:38:34.451930 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 599/1171] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:38:35.351871 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d10d2f4b-b317-4815-8d40-ffd6a08f414c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:35.352415 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d10d2f4b-b317-4815-8d40-ffd6a08f414c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:35.359382 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d10d2f4b-b317-4815-8d40-ffd6a08f414c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:35.359863 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d10d2f4b-b317-4815-8d40-ffd6a08f414c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:35.360291 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d10d2f4b-b317-4815-8d40-ffd6a08f414c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:35.360987 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d10d2f4b-b317-4815-8d40-ffd6a08f414c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:35.361428 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d10d2f4b-b317-4815-8d40-ffd6a08f414c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:35.361846 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d10d2f4b-b317-4815-8d40-ffd6a08f414c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:35.500196 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-d10d2f4b-b317-4815-8d40-ffd6a08f414c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20886161e1f34eedbea38b1ac7efed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977bfbc156b44c7a7ba0c273708b2b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:35.508307 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d10d2f4b-b317-4815-8d40-ffd6a08f414c tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 200 len: 1314 microversion: 2.1 time: 0.162381 Aug 05 10:38:35.509224 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 573/1172] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:35 2022] GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:35.587968 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-38c2bb02-cecd-4664-a07a-64610fcfb774 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:35.588513 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-38c2bb02-cecd-4664-a07a-64610fcfb774 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:35.595081 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-38c2bb02-cecd-4664-a07a-64610fcfb774 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:35.595559 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-38c2bb02-cecd-4664-a07a-64610fcfb774 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:35.595991 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-38c2bb02-cecd-4664-a07a-64610fcfb774 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:35.596682 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-38c2bb02-cecd-4664-a07a-64610fcfb774 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:35.597130 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-38c2bb02-cecd-4664-a07a-64610fcfb774 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:35.597576 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-38c2bb02-cecd-4664-a07a-64610fcfb774 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:35.686116 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-38c2bb02-cecd-4664-a07a-64610fcfb774 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lazy-loading 'services' on Instance uuid db0913eb-a1ef-4529-87c9-50714d985f57 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:38:35.762515 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-38c2bb02-cecd-4664-a07a-64610fcfb774 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "DELETE /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57/os-volume_attachments/55217458-3659-4df8-8da3-41ac7f481177" status: 202 len: 0 microversion: 2.1 time: 0.179411 Aug 05 10:38:35.763136 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 600/1173] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 5 10:38:35 2022] DELETE /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57/os-volume_attachments/55217458-3659-4df8-8da3-41ac7f481177 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:38:36.532057 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b6de406e-85f2-4cfa-ac73-378c0367c9dd tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:36.532888 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b6de406e-85f2-4cfa-ac73-378c0367c9dd tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:36.541044 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b6de406e-85f2-4cfa-ac73-378c0367c9dd tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:36.541527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b6de406e-85f2-4cfa-ac73-378c0367c9dd tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:36.541972 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b6de406e-85f2-4cfa-ac73-378c0367c9dd tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:36.542647 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b6de406e-85f2-4cfa-ac73-378c0367c9dd tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:36.543130 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b6de406e-85f2-4cfa-ac73-378c0367c9dd tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:36.543553 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b6de406e-85f2-4cfa-ac73-378c0367c9dd tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:36.681943 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b6de406e-85f2-4cfa-ac73-378c0367c9dd tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20886161e1f34eedbea38b1ac7efed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977bfbc156b44c7a7ba0c273708b2b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:36.690052 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b6de406e-85f2-4cfa-ac73-378c0367c9dd tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 200 len: 1463 microversion: 2.1 time: 0.163601 Aug 05 10:38:36.690616 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 574/1174] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:36 2022] GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 1463 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:36.741836 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-209aa12b-3262-49b1-8de6-b78638ce04da tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:36.742460 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-209aa12b-3262-49b1-8de6-b78638ce04da tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:36.749104 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-209aa12b-3262-49b1-8de6-b78638ce04da tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:36.749584 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-209aa12b-3262-49b1-8de6-b78638ce04da tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:36.750016 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-209aa12b-3262-49b1-8de6-b78638ce04da tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:36.750706 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-209aa12b-3262-49b1-8de6-b78638ce04da tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:36.751228 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-209aa12b-3262-49b1-8de6-b78638ce04da tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:36.751647 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-209aa12b-3262-49b1-8de6-b78638ce04da tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:36.777658 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-209aa12b-3262-49b1-8de6-b78638ce04da tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 10:38:36.864580 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-209aa12b-3262-49b1-8de6-b78638ce04da tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "DELETE /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 204 len: 0 microversion: 2.1 time: 0.127561 Aug 05 10:38:36.865168 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 601/1175] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:38:36 2022] DELETE /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:38:36.886622 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-188ee0c6-2981-451b-bd3d-f767f330be67 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:36.887364 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-188ee0c6-2981-451b-bd3d-f767f330be67 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:36.893944 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-188ee0c6-2981-451b-bd3d-f767f330be67 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:36.894432 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-188ee0c6-2981-451b-bd3d-f767f330be67 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:36.894874 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-188ee0c6-2981-451b-bd3d-f767f330be67 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:36.895615 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-188ee0c6-2981-451b-bd3d-f767f330be67 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:36.896067 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-188ee0c6-2981-451b-bd3d-f767f330be67 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:36.896542 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-188ee0c6-2981-451b-bd3d-f767f330be67 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:37.036301 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-188ee0c6-2981-451b-bd3d-f767f330be67 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20886161e1f34eedbea38b1ac7efed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977bfbc156b44c7a7ba0c273708b2b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:37.048525 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-188ee0c6-2981-451b-bd3d-f767f330be67 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 200 len: 1469 microversion: 2.1 time: 0.178446 Aug 05 10:38:37.049438 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 575/1176] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:36 2022] GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 1469 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:38.073761 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b368c6e2-6a14-4825-962c-d8bdff9beab3 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:38.074446 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b368c6e2-6a14-4825-962c-d8bdff9beab3 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:38.081298 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b368c6e2-6a14-4825-962c-d8bdff9beab3 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:38.081776 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b368c6e2-6a14-4825-962c-d8bdff9beab3 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:38.082209 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b368c6e2-6a14-4825-962c-d8bdff9beab3 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:38.082928 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b368c6e2-6a14-4825-962c-d8bdff9beab3 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:38.083394 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b368c6e2-6a14-4825-962c-d8bdff9beab3 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:38.083819 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b368c6e2-6a14-4825-962c-d8bdff9beab3 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:38.220964 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b368c6e2-6a14-4825-962c-d8bdff9beab3 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20886161e1f34eedbea38b1ac7efed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977bfbc156b44c7a7ba0c273708b2b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:38.229323 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b368c6e2-6a14-4825-962c-d8bdff9beab3 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 200 len: 1469 microversion: 2.1 time: 0.160197 Aug 05 10:38:38.229892 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 602/1177] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:38 2022] GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 1469 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:39.010619 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-74daedb5-c094-4d44-ac33-66cca168f6a4 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:39.011222 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-74daedb5-c094-4d44-ac33-66cca168f6a4 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:39.018028 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-74daedb5-c094-4d44-ac33-66cca168f6a4 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:39.018519 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-74daedb5-c094-4d44-ac33-66cca168f6a4 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:39.018990 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-74daedb5-c094-4d44-ac33-66cca168f6a4 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:39.019711 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-74daedb5-c094-4d44-ac33-66cca168f6a4 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:39.020170 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-74daedb5-c094-4d44-ac33-66cca168f6a4 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:39.020596 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-74daedb5-c094-4d44-ac33-66cca168f6a4 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:39.046321 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-74daedb5-c094-4d44-ac33-66cca168f6a4 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Going to try to terminate instance {{(pid=117831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 10:38:39.129451 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-74daedb5-c094-4d44-ac33-66cca168f6a4 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "DELETE /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 204 len: 0 microversion: 2.1 time: 0.123142 Aug 05 10:38:39.130013 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 576/1178] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:38:39 2022] DELETE /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:38:39.140384 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3ab55db3-6fde-4180-b30d-a8188c1335e7 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:39.141075 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3ab55db3-6fde-4180-b30d-a8188c1335e7 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:39.143740 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:38:39.150014 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3ab55db3-6fde-4180-b30d-a8188c1335e7 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:39.150775 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3ab55db3-6fde-4180-b30d-a8188c1335e7 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:39.151385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3ab55db3-6fde-4180-b30d-a8188c1335e7 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:39.152388 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3ab55db3-6fde-4180-b30d-a8188c1335e7 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:39.153359 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3ab55db3-6fde-4180-b30d-a8188c1335e7 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:39.153839 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3ab55db3-6fde-4180-b30d-a8188c1335e7 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:39.157931 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:38:39.251467 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-122666ca-d806-45e9-8f8e-2f1044b511c6 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:39.253483 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-122666ca-d806-45e9-8f8e-2f1044b511c6 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:39.283057 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-122666ca-d806-45e9-8f8e-2f1044b511c6 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:39.284052 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-122666ca-d806-45e9-8f8e-2f1044b511c6 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:39.286068 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-122666ca-d806-45e9-8f8e-2f1044b511c6 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:39.287482 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-122666ca-d806-45e9-8f8e-2f1044b511c6 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:39.288325 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-122666ca-d806-45e9-8f8e-2f1044b511c6 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:39.289027 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-122666ca-d806-45e9-8f8e-2f1044b511c6 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:39.315549 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3ab55db3-6fde-4180-b30d-a8188c1335e7 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:39.324098 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3ab55db3-6fde-4180-b30d-a8188c1335e7 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1514 microversion: 2.1 time: 0.189091 Aug 05 10:38:39.324788 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 603/1179] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:39 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1514 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:39.330267 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-ee09308b-3477-49d7-b8c8-25a64b7b103f req-364105ab-3aa9-4955-a878-ad9bcbf6f026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da7c54c9-788f-4a7b-b033-71f677f48bda", "name": "network-vif-deleted", "tag": "cc27fd4d-44c7-42db-8777-39865c07246d"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:38:39.348403 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-ee09308b-3477-49d7-b8c8-25a64b7b103f req-364105ab-3aa9-4955-a878-ad9bcbf6f026 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:39.349045 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-ee09308b-3477-49d7-b8c8-25a64b7b103f req-364105ab-3aa9-4955-a878-ad9bcbf6f026 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:39.349577 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-ee09308b-3477-49d7-b8c8-25a64b7b103f req-364105ab-3aa9-4955-a878-ad9bcbf6f026 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:39.364246 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-ee09308b-3477-49d7-b8c8-25a64b7b103f req-364105ab-3aa9-4955-a878-ad9bcbf6f026 service nova] Creating event network-vif-deleted:cc27fd4d-44c7-42db-8777-39865c07246d for instance da7c54c9-788f-4a7b-b033-71f677f48bda on hv-cinder-81558 Aug 05 10:38:39.369606 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-ee09308b-3477-49d7-b8c8-25a64b7b103f req-364105ab-3aa9-4955-a878-ad9bcbf6f026 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043427 Aug 05 10:38:39.370442 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 604/1180] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:38:39.372958 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-122666ca-d806-45e9-8f8e-2f1044b511c6 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20886161e1f34eedbea38b1ac7efed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977bfbc156b44c7a7ba0c273708b2b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:39.380924 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-122666ca-d806-45e9-8f8e-2f1044b511c6 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 200 len: 1427 microversion: 2.1 time: 0.134778 Aug 05 10:38:39.381570 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 577/1181] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:39 2022] GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 1427 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:40.351758 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b6c7263f-0da4-48cc-a9a5-61d69c8ab966 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:40.352465 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b6c7263f-0da4-48cc-a9a5-61d69c8ab966 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:40.359188 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b6c7263f-0da4-48cc-a9a5-61d69c8ab966 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:40.359656 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b6c7263f-0da4-48cc-a9a5-61d69c8ab966 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:40.360085 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b6c7263f-0da4-48cc-a9a5-61d69c8ab966 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:40.360765 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b6c7263f-0da4-48cc-a9a5-61d69c8ab966 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:40.361209 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b6c7263f-0da4-48cc-a9a5-61d69c8ab966 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:40.361619 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b6c7263f-0da4-48cc-a9a5-61d69c8ab966 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:40.401955 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-acf43c84-3b7c-41cc-b516-9d63c9f36ec6 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:40.402521 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-acf43c84-3b7c-41cc-b516-9d63c9f36ec6 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:40.409239 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-acf43c84-3b7c-41cc-b516-9d63c9f36ec6 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:40.409714 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-acf43c84-3b7c-41cc-b516-9d63c9f36ec6 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:40.410143 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-acf43c84-3b7c-41cc-b516-9d63c9f36ec6 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:40.410840 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-acf43c84-3b7c-41cc-b516-9d63c9f36ec6 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:40.411320 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-acf43c84-3b7c-41cc-b516-9d63c9f36ec6 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:40.411738 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-acf43c84-3b7c-41cc-b516-9d63c9f36ec6 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:40.431711 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:38:40.494447 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-acf43c84-3b7c-41cc-b516-9d63c9f36ec6 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20886161e1f34eedbea38b1ac7efed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977bfbc156b44c7a7ba0c273708b2b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:40.503773 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-acf43c84-3b7c-41cc-b516-9d63c9f36ec6 tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 200 len: 1427 microversion: 2.1 time: 0.105894 Aug 05 10:38:40.504412 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 578/1182] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:40 2022] GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:40.508204 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b6c7263f-0da4-48cc-a9a5-61d69c8ab966 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:40.516427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b6c7263f-0da4-48cc-a9a5-61d69c8ab966 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1514 microversion: 2.1 time: 0.172639 Aug 05 10:38:40.516981 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 605/1183] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:40 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:41.526291 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-718d7462-4768-4dcb-b553-6a64fa3d77af tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:41.527040 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-718d7462-4768-4dcb-b553-6a64fa3d77af tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] [instance: da7c54c9-788f-4a7b-b033-71f677f48bda] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:41.533934 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-718d7462-4768-4dcb-b553-6a64fa3d77af tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:41.534466 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-718d7462-4768-4dcb-b553-6a64fa3d77af tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:41.534932 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-718d7462-4768-4dcb-b553-6a64fa3d77af tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:41.535614 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-718d7462-4768-4dcb-b553-6a64fa3d77af tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:41.536277 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-718d7462-4768-4dcb-b553-6a64fa3d77af tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:41.536865 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-718d7462-4768-4dcb-b553-6a64fa3d77af tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:41.537749 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d6c4d0de-70d9-406d-9b37-5e96e0b76cac tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:41.538725 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d6c4d0de-70d9-406d-9b37-5e96e0b76cac tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:41.545997 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6c4d0de-70d9-406d-9b37-5e96e0b76cac tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:41.546742 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6c4d0de-70d9-406d-9b37-5e96e0b76cac tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:41.547200 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6c4d0de-70d9-406d-9b37-5e96e0b76cac tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:41.547938 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6c4d0de-70d9-406d-9b37-5e96e0b76cac tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:41.548984 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6c4d0de-70d9-406d-9b37-5e96e0b76cac tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:41.549454 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6c4d0de-70d9-406d-9b37-5e96e0b76cac tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:41.553235 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-718d7462-4768-4dcb-b553-6a64fa3d77af tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] HTTP exception thrown: Instance da7c54c9-788f-4a7b-b033-71f677f48bda could not be found. Aug 05 10:38:41.555630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-718d7462-4768-4dcb-b553-6a64fa3d77af tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Request method failure captured: Aug 05 10:38:41.555630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda HTTP/1.1 Aug 05 10:38:41.555630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:38:41.555630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:38:41.555630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:38:41.555630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:38:41.555630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:38:41.555630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:38:41.555630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:38:41.555630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:38:41.555630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PMVujCfIt3oz8GsxqpP_rAxRGLdRbd5Gidtfg-oxp33D52uG2kcS0sLBdgQXWbxkGqvbNqbJOOl_qFbPP_fqPubci_jBLjlkS0FN3jJl-BafC58D5fT5W7tYHtPwf-IV0x3e41JI4SUrlU8QyXEzfn4X9zo6HSjZpSecI4VtOJRI9Y Aug 05 10:38:41.555630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:38:41.555630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:38:41.555630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:38:41.555630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:38:41.555630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:38:41.555630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:38:41.555630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 3977bfbc156b44c7a7ba0c273708b2b1 Aug 05 10:38:41.555630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-VolumesNegativeTest-1364058617 Aug 05 10:38:41.555630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:38:41.555630 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:38:41.557201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3977bfbc156b44c7a7ba0c273708b2b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3977bfbc156b44c7a7ba0c273708b2b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3977bfbc156b44c7a7ba0c273708b2b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3977bfbc156b44c7a7ba0c273708b2b1"}]}] Aug 05 10:38:41.557201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-VolumesNegativeTest-1364058617 Aug 05 10:38:41.557201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 3977bfbc156b44c7a7ba0c273708b2b1 Aug 05 10:38:41.557201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-VolumesNegativeTest-1364058617 Aug 05 10:38:41.557201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-VolumesNegativeTest-1364058617-project Aug 05 10:38:41.557201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:38:41.557201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:38:41.557201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: 20886161e1f34eedbea38b1ac7efed50 Aug 05 10:38:41.557201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-VolumesNegativeTest-1364058617-project Aug 05 10:38:41.557201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: > Aug 05 10:38:41.557201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Instance da7c54c9-788f-4a7b-b033-71f677f48bda could not be found. Aug 05 10:38:41.557201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'id': 'da7c54c9-788f-4a7b-b033-71f677f48bda'} Aug 05 10:38:41.558105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:38:41.558105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:38:41.558105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:38:41.558105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:38:41.558105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:38:41.558105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:38:41.558105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:38:41.558105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:38:41.558105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:38:41.558105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:38:41.558105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da7c54c9-788f-4a7b-b033-71f677f48bda could not be found. Aug 05 10:38:41.558105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:38:41.558105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:38:41.558105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:38:41.558105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:38:41.558105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:38:41.558105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:38:41.558105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:38:41.558105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:38:41.558105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:38:41.559573 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:38:41.559573 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:38:41.559573 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:38:41.559573 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:38:41.559573 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:38:41.559573 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:38:41.559573 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:38:41.559573 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da7c54c9-788f-4a7b-b033-71f677f48bda could not be found. Aug 05 10:38:41.559573 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:38:41.559573 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:38:41.559573 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:38:41.559573 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:38:41.559573 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:38:41.559573 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:38:41.559573 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:38:41.559573 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:38:41.559573 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da7c54c9-788f-4a7b-b033-71f677f48bda could not be found. Aug 05 10:38:41.559573 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:38:41.560811 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-718d7462-4768-4dcb-b553-6a64fa3d77af tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] Returning 404 to user: Instance da7c54c9-788f-4a7b-b033-71f677f48bda could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:38:41.560811 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-718d7462-4768-4dcb-b553-6a64fa3d77af tempest-VolumesNegativeTest-1364058617 tempest-VolumesNegativeTest-1364058617-project] 10.222.0.40 "GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda" status: 404 len: 111 microversion: 2.1 time: 0.034521 Aug 05 10:38:41.560811 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 579/1184] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:41 2022] GET /compute/v2.1/servers/da7c54c9-788f-4a7b-b033-71f677f48bda => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:38:41.622582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d6c4d0de-70d9-406d-9b37-5e96e0b76cac tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:41.631101 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d6c4d0de-70d9-406d-9b37-5e96e0b76cac tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 200 len: 1472 microversion: 2.1 time: 0.097160 Aug 05 10:38:41.631773 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 606/1185] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:41 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 1472 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:41.674872 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-4e506c26-5d32-4f74-91e4-863b1a030f6c req-1c1d669b-5e8d-446c-93e3-7c689503928b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0913eb-a1ef-4529-87c9-50714d985f57", "name": "network-vif-deleted", "tag": "229922ab-edf0-4fae-ae9b-273c59d4d24e"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:38:41.685476 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-4e506c26-5d32-4f74-91e4-863b1a030f6c req-1c1d669b-5e8d-446c-93e3-7c689503928b service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:41.686160 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-4e506c26-5d32-4f74-91e4-863b1a030f6c req-1c1d669b-5e8d-446c-93e3-7c689503928b service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:41.686601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-4e506c26-5d32-4f74-91e4-863b1a030f6c req-1c1d669b-5e8d-446c-93e3-7c689503928b service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:41.701260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-4e506c26-5d32-4f74-91e4-863b1a030f6c req-1c1d669b-5e8d-446c-93e3-7c689503928b service nova] Creating event network-vif-deleted:229922ab-edf0-4fae-ae9b-273c59d4d24e for instance db0913eb-a1ef-4529-87c9-50714d985f57 on hv-cinder-81558 Aug 05 10:38:41.707727 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-4e506c26-5d32-4f74-91e4-863b1a030f6c req-1c1d669b-5e8d-446c-93e3-7c689503928b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036762 Aug 05 10:38:41.708330 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 580/1186] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:38:42.651925 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-eed31a6a-7ae6-49a9-9cce-341a80ffb81f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:42.652537 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-eed31a6a-7ae6-49a9-9cce-341a80ffb81f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: db0913eb-a1ef-4529-87c9-50714d985f57] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:42.659510 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eed31a6a-7ae6-49a9-9cce-341a80ffb81f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:42.660015 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eed31a6a-7ae6-49a9-9cce-341a80ffb81f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:42.660444 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eed31a6a-7ae6-49a9-9cce-341a80ffb81f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:42.661139 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eed31a6a-7ae6-49a9-9cce-341a80ffb81f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:42.661586 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eed31a6a-7ae6-49a9-9cce-341a80ffb81f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:42.661996 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eed31a6a-7ae6-49a9-9cce-341a80ffb81f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:42.676359 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-eed31a6a-7ae6-49a9-9cce-341a80ffb81f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] HTTP exception thrown: Instance db0913eb-a1ef-4529-87c9-50714d985f57 could not be found. Aug 05 10:38:42.678024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-eed31a6a-7ae6-49a9-9cce-341a80ffb81f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Request method failure captured: Aug 05 10:38:42.678024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 HTTP/1.1 Aug 05 10:38:42.678024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:38:42.678024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:38:42.678024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:38:42.678024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:38:42.678024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:38:42.678024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:38:42.678024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:38:42.678024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:38:42.678024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7PLXML2oN_g1biw5H-oqMji64oRSnFOFdFYbjMce2FZOpZumIAOnSbCign72Ef_EkPdgzMMqaLczqHWx-K81d3f2lkF6fsaoGJy2i4nvxfuLfJivyaBvfAIg9kFTVPmtkpd7wHXMDJ7ZpQFdFPXpNbLBy_FjNbu1cUPBR9L_xwX2cfI Aug 05 10:38:42.678024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:38:42.678024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:38:42.678024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:38:42.678024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:38:42.678024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:38:42.678024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:38:42.678024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 2bbcb32efae644d8b8ab1c92fb168a7b Aug 05 10:38:42.678024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesSnapshotTestJSON-470744075 Aug 05 10:38:42.678024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:38:42.678024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:38:42.679798 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2bbcb32efae644d8b8ab1c92fb168a7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2bbcb32efae644d8b8ab1c92fb168a7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2bbcb32efae644d8b8ab1c92fb168a7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2bbcb32efae644d8b8ab1c92fb168a7b"}]}] Aug 05 10:38:42.679798 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesSnapshotTestJSON-470744075 Aug 05 10:38:42.679798 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 2bbcb32efae644d8b8ab1c92fb168a7b Aug 05 10:38:42.679798 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-470744075 Aug 05 10:38:42.679798 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesSnapshotTestJSON-470744075-project Aug 05 10:38:42.679798 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:38:42.679798 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:38:42.679798 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: 85904ab7159f486ea9d5075b285148f7 Aug 05 10:38:42.679798 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesSnapshotTestJSON-470744075-project Aug 05 10:38:42.679798 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:38:42.679798 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Instance db0913eb-a1ef-4529-87c9-50714d985f57 could not be found. Aug 05 10:38:42.679798 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': 'db0913eb-a1ef-4529-87c9-50714d985f57'} Aug 05 10:38:42.681125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:38:42.681125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:38:42.681125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:38:42.681125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:38:42.681125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:38:42.681125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:38:42.681125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:38:42.681125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:38:42.681125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:38:42.681125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:38:42.681125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db0913eb-a1ef-4529-87c9-50714d985f57 could not be found. Aug 05 10:38:42.681125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:38:42.681125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:38:42.681125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:38:42.681125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:38:42.681125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:38:42.681125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:38:42.681125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:38:42.681125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:38:42.681125 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:38:42.682649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:38:42.682649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:38:42.682649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:38:42.682649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:38:42.682649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:38:42.682649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:38:42.682649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:38:42.682649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db0913eb-a1ef-4529-87c9-50714d985f57 could not be found. Aug 05 10:38:42.682649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:38:42.682649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:38:42.682649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:38:42.682649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:38:42.682649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:38:42.682649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:38:42.682649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:38:42.682649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:38:42.682649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db0913eb-a1ef-4529-87c9-50714d985f57 could not be found. Aug 05 10:38:42.682649 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:38:42.684000 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-eed31a6a-7ae6-49a9-9cce-341a80ffb81f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Returning 404 to user: Instance db0913eb-a1ef-4529-87c9-50714d985f57 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:38:42.684000 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-eed31a6a-7ae6-49a9-9cce-341a80ffb81f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57" status: 404 len: 111 microversion: 2.1 time: 0.031528 Aug 05 10:38:42.684000 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 607/1187] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:42 2022] GET /compute/v2.1/servers/db0913eb-a1ef-4529-87c9-50714d985f57 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:38:52.691088 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-6a781206-d7d8-43d9-b8f1-258fc7779d33 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1146926096", "imageRef": "6163bb7c-dfd7-4fb1-a3cb-9f4818243f78", "flavorRef": "452", "networks": [{"uuid": "d8703152-44d8-49a4-b955-8031363f929c"}]}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:38:52.699622 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:38:52.700275 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=6 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:38:52.749119 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.network.neutron [None req-6a781206-d7d8-43d9-b8f1-258fc7779d33 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] validate_networks() for [('d8703152-44d8-49a4-b955-8031363f929c', None, None, None, None, None)] {{(pid=117831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 10:38:53.212084 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-6a781206-d7d8-43d9-b8f1-258fc7779d33 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Flavor limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 10:38:53.212512 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-6a781206-d7d8-43d9-b8f1-258fc7779d33 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Image limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 10:38:53.212994 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-6a781206-d7d8-43d9-b8f1-258fc7779d33 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Flavor pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 10:38:53.213385 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-6a781206-d7d8-43d9-b8f1-258fc7779d33 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Image pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 10:38:53.213800 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-6a781206-d7d8-43d9-b8f1-258fc7779d33 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 10:38:53.223628 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6a781206-d7d8-43d9-b8f1-258fc7779d33 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:53.224118 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6a781206-d7d8-43d9-b8f1-258fc7779d33 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:53.224555 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6a781206-d7d8-43d9-b8f1-258fc7779d33 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:53.225288 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6a781206-d7d8-43d9-b8f1-258fc7779d33 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:53.225742 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6a781206-d7d8-43d9-b8f1-258fc7779d33 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:53.226172 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6a781206-d7d8-43d9-b8f1-258fc7779d33 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:53.244119 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-6a781206-d7d8-43d9-b8f1-258fc7779d33 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Getting quotas for project 2bbcb32efae644d8b8ab1c92fb168a7b. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:38:53.248460 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-6a781206-d7d8-43d9-b8f1-258fc7779d33 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Getting quotas for user 85904ab7159f486ea9d5075b285148f7 and project 2bbcb32efae644d8b8ab1c92fb168a7b. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:38:53.260668 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-6a781206-d7d8-43d9-b8f1-258fc7779d33 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Going to run 1 instances... {{(pid=117831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 10:38:53.263062 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-6a781206-d7d8-43d9-b8f1-258fc7779d33 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: 4f8e9a7a-2c19-4bd3-9704-d11e4a675091] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6163bb7c-dfd7-4fb1-a3cb-9f4818243f78',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 10:38:53.311500 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-6a781206-d7d8-43d9-b8f1-258fc7779d33 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624733 Aug 05 10:38:53.312350 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 581/1188] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 10:38:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 10:38:53.323296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-41d8e097-93cc-49f0-8fcd-a8e6cd5fd25f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:53.323912 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-41d8e097-93cc-49f0-8fcd-a8e6cd5fd25f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: 4f8e9a7a-2c19-4bd3-9704-d11e4a675091] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:53.329013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=9 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:38:53.329775 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=21 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:38:53.384625 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-41d8e097-93cc-49f0-8fcd-a8e6cd5fd25f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:53.392005 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-41d8e097-93cc-49f0-8fcd-a8e6cd5fd25f tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091" status: 200 len: 1219 microversion: 2.1 time: 0.072515 Aug 05 10:38:53.393252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 608/1189] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:53 2022] GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:54.413811 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-516d573c-93f2-4c5d-9bb3-351276d334d0 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:54.415202 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-516d573c-93f2-4c5d-9bb3-351276d334d0 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: 4f8e9a7a-2c19-4bd3-9704-d11e4a675091] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:54.422066 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-516d573c-93f2-4c5d-9bb3-351276d334d0 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:54.422553 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-516d573c-93f2-4c5d-9bb3-351276d334d0 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:54.423240 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-516d573c-93f2-4c5d-9bb3-351276d334d0 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:54.423948 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-516d573c-93f2-4c5d-9bb3-351276d334d0 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:54.424397 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-516d573c-93f2-4c5d-9bb3-351276d334d0 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:54.425018 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-516d573c-93f2-4c5d-9bb3-351276d334d0 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:54.529985 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-516d573c-93f2-4c5d-9bb3-351276d334d0 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:54.537744 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-516d573c-93f2-4c5d-9bb3-351276d334d0 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091" status: 200 len: 1289 microversion: 2.1 time: 0.127886 Aug 05 10:38:54.538698 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 582/1190] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:54 2022] GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091 => generated 1289 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:55.558696 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fe51be25-a244-4456-b1f2-6f26a4ea39ad tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:55.559326 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fe51be25-a244-4456-b1f2-6f26a4ea39ad tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: 4f8e9a7a-2c19-4bd3-9704-d11e4a675091] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:55.566783 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fe51be25-a244-4456-b1f2-6f26a4ea39ad tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:55.567730 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fe51be25-a244-4456-b1f2-6f26a4ea39ad tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:55.567730 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fe51be25-a244-4456-b1f2-6f26a4ea39ad tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:55.568445 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fe51be25-a244-4456-b1f2-6f26a4ea39ad tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:55.568904 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fe51be25-a244-4456-b1f2-6f26a4ea39ad tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:55.569725 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fe51be25-a244-4456-b1f2-6f26a4ea39ad tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:55.690087 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-e0459d4e-1302-48c8-a60c-80ea82fd3aed req-d5f7e898-7d88-4313-9ec8-049cd9cc3a0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f8e9a7a-2c19-4bd3-9704-d11e4a675091", "tag": "712f12bf-cfe2-4ed8-a605-941e7c368863"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:38:55.701386 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-e0459d4e-1302-48c8-a60c-80ea82fd3aed req-d5f7e898-7d88-4313-9ec8-049cd9cc3a0d service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:55.702391 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-e0459d4e-1302-48c8-a60c-80ea82fd3aed req-d5f7e898-7d88-4313-9ec8-049cd9cc3a0d service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:55.703389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-e0459d4e-1302-48c8-a60c-80ea82fd3aed req-d5f7e898-7d88-4313-9ec8-049cd9cc3a0d service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:55.715605 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-e0459d4e-1302-48c8-a60c-80ea82fd3aed req-d5f7e898-7d88-4313-9ec8-049cd9cc3a0d service nova] Creating event network-changed:712f12bf-cfe2-4ed8-a605-941e7c368863 for instance 4f8e9a7a-2c19-4bd3-9704-d11e4a675091 on hv-cinder-81558 Aug 05 10:38:55.717217 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fe51be25-a244-4456-b1f2-6f26a4ea39ad tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:55.721098 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-e0459d4e-1302-48c8-a60c-80ea82fd3aed req-d5f7e898-7d88-4313-9ec8-049cd9cc3a0d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035136 Aug 05 10:38:55.722328 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 583/1191] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:38:55.725864 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fe51be25-a244-4456-b1f2-6f26a4ea39ad tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091" status: 200 len: 1319 microversion: 2.1 time: 0.170997 Aug 05 10:38:55.738948 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 609/1192] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:55 2022] GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:56.749179 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-2659337d-326b-4fd7-b238-85cdc9268bd2 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:56.749879 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-2659337d-326b-4fd7-b238-85cdc9268bd2 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: 4f8e9a7a-2c19-4bd3-9704-d11e4a675091] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:56.756952 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2659337d-326b-4fd7-b238-85cdc9268bd2 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:56.757448 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2659337d-326b-4fd7-b238-85cdc9268bd2 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:56.758215 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2659337d-326b-4fd7-b238-85cdc9268bd2 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:56.758937 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2659337d-326b-4fd7-b238-85cdc9268bd2 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:56.759384 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2659337d-326b-4fd7-b238-85cdc9268bd2 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:56.759808 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2659337d-326b-4fd7-b238-85cdc9268bd2 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:56.905675 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2659337d-326b-4fd7-b238-85cdc9268bd2 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:56.913632 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-2659337d-326b-4fd7-b238-85cdc9268bd2 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091" status: 200 len: 1319 microversion: 2.1 time: 0.168787 Aug 05 10:38:56.914199 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 584/1193] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:56 2022] GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:57.940052 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e23bb15e-bf30-4b04-9a90-5c2e7aa1380e tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:57.940987 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e23bb15e-bf30-4b04-9a90-5c2e7aa1380e tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: 4f8e9a7a-2c19-4bd3-9704-d11e4a675091] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:57.952093 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e23bb15e-bf30-4b04-9a90-5c2e7aa1380e tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:57.952562 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e23bb15e-bf30-4b04-9a90-5c2e7aa1380e tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:57.952991 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e23bb15e-bf30-4b04-9a90-5c2e7aa1380e tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:57.953677 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e23bb15e-bf30-4b04-9a90-5c2e7aa1380e tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:57.954119 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e23bb15e-bf30-4b04-9a90-5c2e7aa1380e tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:57.954534 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e23bb15e-bf30-4b04-9a90-5c2e7aa1380e tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:58.095251 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e23bb15e-bf30-4b04-9a90-5c2e7aa1380e tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:58.103139 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e23bb15e-bf30-4b04-9a90-5c2e7aa1380e tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091" status: 200 len: 1319 microversion: 2.1 time: 0.169686 Aug 05 10:38:58.103707 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 610/1194] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:57 2022] GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:38:59.134660 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b5e0cd71-f1a9-4ba7-b8d5-9e8242ad42ec tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:38:59.135643 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b5e0cd71-f1a9-4ba7-b8d5-9e8242ad42ec tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: 4f8e9a7a-2c19-4bd3-9704-d11e4a675091] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:38:59.146708 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b5e0cd71-f1a9-4ba7-b8d5-9e8242ad42ec tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:59.147564 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b5e0cd71-f1a9-4ba7-b8d5-9e8242ad42ec tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:59.148283 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b5e0cd71-f1a9-4ba7-b8d5-9e8242ad42ec tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:59.149428 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b5e0cd71-f1a9-4ba7-b8d5-9e8242ad42ec tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:38:59.150168 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b5e0cd71-f1a9-4ba7-b8d5-9e8242ad42ec tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:38:59.150879 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b5e0cd71-f1a9-4ba7-b8d5-9e8242ad42ec tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:38:59.300514 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b5e0cd71-f1a9-4ba7-b8d5-9e8242ad42ec tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:38:59.308643 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b5e0cd71-f1a9-4ba7-b8d5-9e8242ad42ec tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091" status: 200 len: 1319 microversion: 2.1 time: 0.180970 Aug 05 10:38:59.309219 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 585/1195] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:38:59 2022] GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:39:00.333800 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-afcb56e2-ed6c-4133-89e4-973161d022d7 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:39:00.335030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-afcb56e2-ed6c-4133-89e4-973161d022d7 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: 4f8e9a7a-2c19-4bd3-9704-d11e4a675091] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:39:00.344274 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afcb56e2-ed6c-4133-89e4-973161d022d7 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:00.344785 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afcb56e2-ed6c-4133-89e4-973161d022d7 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:00.345197 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afcb56e2-ed6c-4133-89e4-973161d022d7 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:00.345898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afcb56e2-ed6c-4133-89e4-973161d022d7 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:00.346341 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afcb56e2-ed6c-4133-89e4-973161d022d7 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:00.346759 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afcb56e2-ed6c-4133-89e4-973161d022d7 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:00.481688 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-afcb56e2-ed6c-4133-89e4-973161d022d7 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:39:00.489433 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-afcb56e2-ed6c-4133-89e4-973161d022d7 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091" status: 200 len: 1319 microversion: 2.1 time: 0.161913 Aug 05 10:39:00.489986 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 611/1196] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:39:00 2022] GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:39:01.514876 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-3957a863-0ca1-4efe-b598-46c094cca577 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:39:01.515633 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-3957a863-0ca1-4efe-b598-46c094cca577 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: 4f8e9a7a-2c19-4bd3-9704-d11e4a675091] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:39:01.524065 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3957a863-0ca1-4efe-b598-46c094cca577 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:01.524661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3957a863-0ca1-4efe-b598-46c094cca577 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:01.525199 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3957a863-0ca1-4efe-b598-46c094cca577 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:01.526049 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3957a863-0ca1-4efe-b598-46c094cca577 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:01.526607 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3957a863-0ca1-4efe-b598-46c094cca577 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:01.527170 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3957a863-0ca1-4efe-b598-46c094cca577 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:01.668848 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-3957a863-0ca1-4efe-b598-46c094cca577 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:39:01.676616 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-3957a863-0ca1-4efe-b598-46c094cca577 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091" status: 200 len: 1319 microversion: 2.1 time: 0.168429 Aug 05 10:39:01.677436 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 586/1197] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:39:01 2022] GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:39:02.527013 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-5319c596-b751-4ab7-985c-2399104d62b7 req-064ae669-2971-4b88-922e-f4c03de187a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8e9a7a-2c19-4bd3-9704-d11e4a675091", "name": "network-vif-plugged", "status": "completed", "tag": "712f12bf-cfe2-4ed8-a605-941e7c368863"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:39:02.537953 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-5319c596-b751-4ab7-985c-2399104d62b7 req-064ae669-2971-4b88-922e-f4c03de187a8 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:02.538430 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-5319c596-b751-4ab7-985c-2399104d62b7 req-064ae669-2971-4b88-922e-f4c03de187a8 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:02.538855 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-5319c596-b751-4ab7-985c-2399104d62b7 req-064ae669-2971-4b88-922e-f4c03de187a8 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:02.551149 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-5319c596-b751-4ab7-985c-2399104d62b7 req-064ae669-2971-4b88-922e-f4c03de187a8 service nova] Creating event network-vif-plugged:712f12bf-cfe2-4ed8-a605-941e7c368863 for instance 4f8e9a7a-2c19-4bd3-9704-d11e4a675091 on hv-cinder-81558 Aug 05 10:39:02.556171 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-5319c596-b751-4ab7-985c-2399104d62b7 req-064ae669-2971-4b88-922e-f4c03de187a8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032964 Aug 05 10:39:02.556951 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 612/1198] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:39:02.703659 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-8a0ff756-e014-45fe-8e4c-6fc726965b3d tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:39:02.704265 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-8a0ff756-e014-45fe-8e4c-6fc726965b3d tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: 4f8e9a7a-2c19-4bd3-9704-d11e4a675091] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:39:02.710884 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8a0ff756-e014-45fe-8e4c-6fc726965b3d tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:02.711391 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8a0ff756-e014-45fe-8e4c-6fc726965b3d tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:02.711825 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8a0ff756-e014-45fe-8e4c-6fc726965b3d tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:02.712512 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8a0ff756-e014-45fe-8e4c-6fc726965b3d tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:02.712963 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8a0ff756-e014-45fe-8e4c-6fc726965b3d tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:02.713403 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8a0ff756-e014-45fe-8e4c-6fc726965b3d tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:02.889764 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-8a0ff756-e014-45fe-8e4c-6fc726965b3d tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:39:02.901039 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-8a0ff756-e014-45fe-8e4c-6fc726965b3d tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091" status: 200 len: 1319 microversion: 2.1 time: 0.201003 Aug 05 10:39:02.901736 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 587/1199] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:39:02 2022] GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:39:03.923710 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:39:03.931379 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-26c35431-579c-4542-9755-39ffb4baf679 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:39:03.932509 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-26c35431-579c-4542-9755-39ffb4baf679 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: 4f8e9a7a-2c19-4bd3-9704-d11e4a675091] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:39:03.941468 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-26c35431-579c-4542-9755-39ffb4baf679 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:03.941878 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-26c35431-579c-4542-9755-39ffb4baf679 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:03.942302 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-26c35431-579c-4542-9755-39ffb4baf679 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:03.943014 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-26c35431-579c-4542-9755-39ffb4baf679 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:03.943460 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-26c35431-579c-4542-9755-39ffb4baf679 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:03.943875 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-26c35431-579c-4542-9755-39ffb4baf679 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:04.085652 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-26c35431-579c-4542-9755-39ffb4baf679 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:39:04.093818 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-26c35431-579c-4542-9755-39ffb4baf679 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091" status: 200 len: 1319 microversion: 2.1 time: 0.172263 Aug 05 10:39:04.094444 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 613/1200] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:39:03 2022] GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:39:05.115068 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f79fa740-f905-478d-8a3f-0a5411b60c88 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:39:05.115812 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f79fa740-f905-478d-8a3f-0a5411b60c88 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: 4f8e9a7a-2c19-4bd3-9704-d11e4a675091] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:39:05.117807 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=2 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:39:05.118484 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=6 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:39:05.126107 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f79fa740-f905-478d-8a3f-0a5411b60c88 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:05.127237 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f79fa740-f905-478d-8a3f-0a5411b60c88 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:05.127396 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f79fa740-f905-478d-8a3f-0a5411b60c88 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:05.127973 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f79fa740-f905-478d-8a3f-0a5411b60c88 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:05.128425 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f79fa740-f905-478d-8a3f-0a5411b60c88 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:05.128850 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f79fa740-f905-478d-8a3f-0a5411b60c88 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:05.273767 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-f79fa740-f905-478d-8a3f-0a5411b60c88 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:39:05.282014 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f79fa740-f905-478d-8a3f-0a5411b60c88 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091" status: 200 len: 1509 microversion: 2.1 time: 0.171169 Aug 05 10:39:05.282581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 588/1201] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:39:05 2022] GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091 => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:39:05.302730 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-58015fe7-a868-42ca-92d3-b80caeb1cd8b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0db07ff3-b6c5-4154-bb69-9053d54c9e79", "device": "/dev/sdb"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:39:05.305135 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-58015fe7-a868-42ca-92d3-b80caeb1cd8b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: 4f8e9a7a-2c19-4bd3-9704-d11e4a675091] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:39:05.311702 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-58015fe7-a868-42ca-92d3-b80caeb1cd8b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:05.312168 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-58015fe7-a868-42ca-92d3-b80caeb1cd8b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:05.312614 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-58015fe7-a868-42ca-92d3-b80caeb1cd8b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:05.313261 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-58015fe7-a868-42ca-92d3-b80caeb1cd8b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:05.313726 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-58015fe7-a868-42ca-92d3-b80caeb1cd8b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:05.314109 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-58015fe7-a868-42ca-92d3-b80caeb1cd8b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:05.596954 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-58015fe7-a868-42ca-92d3-b80caeb1cd8b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "POST /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298049 Aug 05 10:39:05.597571 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 614/1202] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 5 10:39:05 2022] POST /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:39:27.212827 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-cb82c9a4-1d2b-4849-a1a0-17cec715c98b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:39:27.213423 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-cb82c9a4-1d2b-4849-a1a0-17cec715c98b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: 4f8e9a7a-2c19-4bd3-9704-d11e4a675091] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:39:27.215470 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:39:27.216241 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=40 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:39:27.222380 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cb82c9a4-1d2b-4849-a1a0-17cec715c98b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:27.222861 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cb82c9a4-1d2b-4849-a1a0-17cec715c98b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:27.223319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cb82c9a4-1d2b-4849-a1a0-17cec715c98b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:27.224008 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cb82c9a4-1d2b-4849-a1a0-17cec715c98b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:27.224457 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cb82c9a4-1d2b-4849-a1a0-17cec715c98b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:27.224872 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cb82c9a4-1d2b-4849-a1a0-17cec715c98b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:27.310611 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.objects.instance [None req-cb82c9a4-1d2b-4849-a1a0-17cec715c98b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lazy-loading 'services' on Instance uuid 4f8e9a7a-2c19-4bd3-9704-d11e4a675091 {{(pid=117831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:39:27.394497 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-cb82c9a4-1d2b-4849-a1a0-17cec715c98b tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091/os-volume_attachments/0db07ff3-b6c5-4154-bb69-9053d54c9e79" status: 202 len: 0 microversion: 2.1 time: 0.185601 Aug 05 10:39:27.395148 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 589/1203] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 5 10:39:27 2022] DELETE /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091/os-volume_attachments/0db07ff3-b6c5-4154-bb69-9053d54c9e79 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:39:28.518362 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=16 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:39:28.519384 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:39:28.523543 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b7cde67d-ae49-4881-9443-6c0f00ce91eb tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:39:28.524166 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b7cde67d-ae49-4881-9443-6c0f00ce91eb tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: 4f8e9a7a-2c19-4bd3-9704-d11e4a675091] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:39:28.532360 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b7cde67d-ae49-4881-9443-6c0f00ce91eb tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:28.532769 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b7cde67d-ae49-4881-9443-6c0f00ce91eb tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:28.533276 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b7cde67d-ae49-4881-9443-6c0f00ce91eb tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:28.533988 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b7cde67d-ae49-4881-9443-6c0f00ce91eb tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:28.534441 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b7cde67d-ae49-4881-9443-6c0f00ce91eb tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:28.534955 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b7cde67d-ae49-4881-9443-6c0f00ce91eb tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:28.561701 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b7cde67d-ae49-4881-9443-6c0f00ce91eb tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: 4f8e9a7a-2c19-4bd3-9704-d11e4a675091] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 10:39:28.646865 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b7cde67d-ae49-4881-9443-6c0f00ce91eb tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091" status: 204 len: 0 microversion: 2.1 time: 0.129616 Aug 05 10:39:28.647967 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 615/1204] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:39:28 2022] DELETE /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:39:28.657923 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-639824ef-b3cc-405b-9e1b-8d9edb8ab92e tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:39:28.658588 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-639824ef-b3cc-405b-9e1b-8d9edb8ab92e tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: 4f8e9a7a-2c19-4bd3-9704-d11e4a675091] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:39:28.665469 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-639824ef-b3cc-405b-9e1b-8d9edb8ab92e tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:28.665955 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-639824ef-b3cc-405b-9e1b-8d9edb8ab92e tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:28.666398 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-639824ef-b3cc-405b-9e1b-8d9edb8ab92e tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:28.667119 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-639824ef-b3cc-405b-9e1b-8d9edb8ab92e tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:28.667568 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-639824ef-b3cc-405b-9e1b-8d9edb8ab92e tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:28.667987 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-639824ef-b3cc-405b-9e1b-8d9edb8ab92e tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:28.800414 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-639824ef-b3cc-405b-9e1b-8d9edb8ab92e tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:39:28.808223 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-639824ef-b3cc-405b-9e1b-8d9edb8ab92e tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091" status: 200 len: 1515 microversion: 2.1 time: 0.155539 Aug 05 10:39:28.808784 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 590/1205] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:39:28 2022] GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:39:29.834189 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-47b950a4-032f-4921-bb74-a9cd07c2aacc tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:39:29.835369 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-47b950a4-032f-4921-bb74-a9cd07c2aacc tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: 4f8e9a7a-2c19-4bd3-9704-d11e4a675091] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:39:29.842806 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47b950a4-032f-4921-bb74-a9cd07c2aacc tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:29.843259 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47b950a4-032f-4921-bb74-a9cd07c2aacc tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:29.843688 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47b950a4-032f-4921-bb74-a9cd07c2aacc tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:29.844371 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47b950a4-032f-4921-bb74-a9cd07c2aacc tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:29.844809 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47b950a4-032f-4921-bb74-a9cd07c2aacc tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:29.845221 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-47b950a4-032f-4921-bb74-a9cd07c2aacc tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:29.977814 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-47b950a4-032f-4921-bb74-a9cd07c2aacc tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:39:29.989929 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-47b950a4-032f-4921-bb74-a9cd07c2aacc tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091" status: 200 len: 1515 microversion: 2.1 time: 0.162713 Aug 05 10:39:29.990726 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 616/1206] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:39:29 2022] GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:39:31.012265 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-4a4c614d-5764-4675-b872-2ff5e6c98db6 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:39:31.012899 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-4a4c614d-5764-4675-b872-2ff5e6c98db6 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: 4f8e9a7a-2c19-4bd3-9704-d11e4a675091] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:39:31.019656 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4a4c614d-5764-4675-b872-2ff5e6c98db6 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:31.020146 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4a4c614d-5764-4675-b872-2ff5e6c98db6 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:31.020581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4a4c614d-5764-4675-b872-2ff5e6c98db6 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:31.021278 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4a4c614d-5764-4675-b872-2ff5e6c98db6 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:31.021729 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4a4c614d-5764-4675-b872-2ff5e6c98db6 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:31.022151 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-4a4c614d-5764-4675-b872-2ff5e6c98db6 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:31.228749 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-6e388f4e-2ffb-404e-807c-b05c7c067c82 req-1bb603fc-ff45-4960-9653-e3536ac69ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8e9a7a-2c19-4bd3-9704-d11e4a675091", "name": "network-vif-deleted", "tag": "712f12bf-cfe2-4ed8-a605-941e7c368863"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:39:31.234003 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-4a4c614d-5764-4675-b872-2ff5e6c98db6 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85904ab7159f486ea9d5075b285148f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbcb32efae644d8b8ab1c92fb168a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:39:31.242187 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-6e388f4e-2ffb-404e-807c-b05c7c067c82 req-1bb603fc-ff45-4960-9653-e3536ac69ba6 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:31.242997 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-6e388f4e-2ffb-404e-807c-b05c7c067c82 req-1bb603fc-ff45-4960-9653-e3536ac69ba6 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:31.243433 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-6e388f4e-2ffb-404e-807c-b05c7c067c82 req-1bb603fc-ff45-4960-9653-e3536ac69ba6 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:31.243651 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-4a4c614d-5764-4675-b872-2ff5e6c98db6 tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091" status: 200 len: 1515 microversion: 2.1 time: 0.235587 Aug 05 10:39:31.244337 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 591/1207] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:39:31 2022] GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091 => generated 1515 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:39:31.258150 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-6e388f4e-2ffb-404e-807c-b05c7c067c82 req-1bb603fc-ff45-4960-9653-e3536ac69ba6 service nova] Creating event network-vif-deleted:712f12bf-cfe2-4ed8-a605-941e7c368863 for instance 4f8e9a7a-2c19-4bd3-9704-d11e4a675091 on hv-cinder-81558 Aug 05 10:39:31.264099 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-6e388f4e-2ffb-404e-807c-b05c7c067c82 req-1bb603fc-ff45-4960-9653-e3536ac69ba6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038880 Aug 05 10:39:31.264627 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 617/1208] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:39:32.265086 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-53884c5c-7444-4fea-b9d5-8d0b0511f18a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:39:32.265713 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-53884c5c-7444-4fea-b9d5-8d0b0511f18a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] [instance: 4f8e9a7a-2c19-4bd3-9704-d11e4a675091] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:39:32.275335 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-53884c5c-7444-4fea-b9d5-8d0b0511f18a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:32.275845 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-53884c5c-7444-4fea-b9d5-8d0b0511f18a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:32.276282 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-53884c5c-7444-4fea-b9d5-8d0b0511f18a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:32.276989 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-53884c5c-7444-4fea-b9d5-8d0b0511f18a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:39:32.277440 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-53884c5c-7444-4fea-b9d5-8d0b0511f18a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:39:32.277862 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-53884c5c-7444-4fea-b9d5-8d0b0511f18a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:39:32.291899 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-53884c5c-7444-4fea-b9d5-8d0b0511f18a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] HTTP exception thrown: Instance 4f8e9a7a-2c19-4bd3-9704-d11e4a675091 could not be found. Aug 05 10:39:32.293527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-53884c5c-7444-4fea-b9d5-8d0b0511f18a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Request method failure captured: Aug 05 10:39:32.293527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091 HTTP/1.1 Aug 05 10:39:32.293527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:39:32.293527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:39:32.293527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:39:32.293527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:39:32.293527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:39:32.293527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:39:32.293527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:39:32.293527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:39:32.293527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7PLXML2oN_g1biw5H-oqMji64oRSnFOFdFYbjMce2FZOpZumIAOnSbCign72Ef_EkPdgzMMqaLczqHWx-K81d3f2lkF6fsaoGJy2i4nvxfuLfJivyaBvfAIg9kFTVPmtkpd7wHXMDJ7ZpQFdFPXpNbLBy_FjNbu1cUPBR9L_xwX2cfI Aug 05 10:39:32.293527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:39:32.293527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:39:32.293527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:39:32.293527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:39:32.293527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:39:32.293527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:39:32.293527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 2bbcb32efae644d8b8ab1c92fb168a7b Aug 05 10:39:32.293527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-VolumesSnapshotTestJSON-470744075 Aug 05 10:39:32.293527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:39:32.293527 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:39:32.295201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2bbcb32efae644d8b8ab1c92fb168a7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2bbcb32efae644d8b8ab1c92fb168a7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2bbcb32efae644d8b8ab1c92fb168a7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2bbcb32efae644d8b8ab1c92fb168a7b"}]}] Aug 05 10:39:32.295201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-VolumesSnapshotTestJSON-470744075 Aug 05 10:39:32.295201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 2bbcb32efae644d8b8ab1c92fb168a7b Aug 05 10:39:32.295201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-470744075 Aug 05 10:39:32.295201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-VolumesSnapshotTestJSON-470744075-project Aug 05 10:39:32.295201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:39:32.295201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:39:32.295201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: 85904ab7159f486ea9d5075b285148f7 Aug 05 10:39:32.295201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-VolumesSnapshotTestJSON-470744075-project Aug 05 10:39:32.295201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: > Aug 05 10:39:32.295201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Instance 4f8e9a7a-2c19-4bd3-9704-d11e4a675091 could not be found. Aug 05 10:39:32.295201 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'id': '4f8e9a7a-2c19-4bd3-9704-d11e4a675091'} Aug 05 10:39:32.296236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:39:32.296236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:39:32.296236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:39:32.296236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:39:32.296236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:39:32.296236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:39:32.296236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:39:32.296236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:39:32.296236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:39:32.296236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:39:32.296236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f8e9a7a-2c19-4bd3-9704-d11e4a675091 could not be found. Aug 05 10:39:32.296236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:39:32.296236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:39:32.296236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:39:32.296236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:39:32.296236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:39:32.296236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:39:32.296236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:39:32.296236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:39:32.296236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:39:32.298355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:39:32.298355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:39:32.298355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:39:32.298355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:39:32.298355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:39:32.298355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:39:32.298355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:39:32.298355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f8e9a7a-2c19-4bd3-9704-d11e4a675091 could not be found. Aug 05 10:39:32.298355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:39:32.298355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:39:32.298355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:39:32.298355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:39:32.298355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:39:32.298355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:39:32.298355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:39:32.298355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:39:32.298355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f8e9a7a-2c19-4bd3-9704-d11e4a675091 could not be found. Aug 05 10:39:32.298355 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:39:32.299769 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-53884c5c-7444-4fea-b9d5-8d0b0511f18a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] Returning 404 to user: Instance 4f8e9a7a-2c19-4bd3-9704-d11e4a675091 could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:39:32.299769 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-53884c5c-7444-4fea-b9d5-8d0b0511f18a tempest-VolumesSnapshotTestJSON-470744075 tempest-VolumesSnapshotTestJSON-470744075-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091" status: 404 len: 111 microversion: 2.1 time: 0.033905 Aug 05 10:39:32.299769 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 592/1209] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:39:32 2022] GET /compute/v2.1/servers/4f8e9a7a-2c19-4bd3-9704-d11e4a675091 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:39:33.991458 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 10:39:33.992383 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Fri Aug 5 10:39:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 10:40:30.042189 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:40:30.042887 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:40:30.209115 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5918ca48-e400-486f-960e-bb9093f3e3d6 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Action: 'create', calling method: .version_select at 0x7f732c0c9940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1855561432", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1fYnmXVQv03WP4SxnYNEuqM8skzmTUXvWqvyvjJk3OX7YCc54xfwmvdFtCeKFjLI//4ukYKBCK7WFTg4Y3FSeyeCJbYILv6TvHXx6l+bIX0Wy64MP054qFV8LWRvYKkQ=="}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:40:30.225160 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-5918ca48-e400-486f-960e-bb9093f3e3d6 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Getting quotas for project 28cf7e20408a43c3bff9f70ad661d638. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:40:30.229458 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-5918ca48-e400-486f-960e-bb9093f3e3d6 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Getting quotas for user c93e81531ea54583b11f5a6c107c9166 and project 28cf7e20408a43c3bff9f70ad661d638. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:40:30.257203 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5918ca48-e400-486f-960e-bb9093f3e3d6 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.227090 Aug 05 10:40:30.257818 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 618/1210] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 5 10:40:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:40:51.923113 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=8 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:40:51.923857 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:40:51.928093 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-401e2c3e-6981-4054-aeb8-a7acac508f4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-918464778", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1855561432", "security_groups": [{"name": "tempest-secgroup-smoke-116129686"}], "block_device_mapping_v2": [{"uuid": "7aef519f-76cb-4dbd-ba5b-5fa2f6b86fb3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "96bc74ca-f39c-4f14-b9e3-8c46e8c7690b"}]}} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:40:52.048236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.network.neutron [None req-401e2c3e-6981-4054-aeb8-a7acac508f4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] validate_networks() for [('96bc74ca-f39c-4f14-b9e3-8c46e8c7690b', None, None, None, None, None)] {{(pid=117831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 10:40:52.449558 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-401e2c3e-6981-4054-aeb8-a7acac508f4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Flavor limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 10:40:52.450109 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-401e2c3e-6981-4054-aeb8-a7acac508f4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Image limits 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 10:40:52.450779 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-401e2c3e-6981-4054-aeb8-a7acac508f4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Flavor pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 10:40:52.451390 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-401e2c3e-6981-4054-aeb8-a7acac508f4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Image pref 0:0:0 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 10:40:52.451963 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.virt.hardware [None req-401e2c3e-6981-4054-aeb8-a7acac508f4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 10:40:52.461448 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-401e2c3e-6981-4054-aeb8-a7acac508f4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:40:52.461971 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-401e2c3e-6981-4054-aeb8-a7acac508f4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:40:52.462416 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-401e2c3e-6981-4054-aeb8-a7acac508f4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:40:52.463321 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-401e2c3e-6981-4054-aeb8-a7acac508f4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:40:52.463782 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-401e2c3e-6981-4054-aeb8-a7acac508f4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:40:52.464209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-401e2c3e-6981-4054-aeb8-a7acac508f4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:40:52.481196 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-401e2c3e-6981-4054-aeb8-a7acac508f4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Getting quotas for project 28cf7e20408a43c3bff9f70ad661d638. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:40:52.485541 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.quota [None req-401e2c3e-6981-4054-aeb8-a7acac508f4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Getting quotas for user c93e81531ea54583b11f5a6c107c9166 and project 28cf7e20408a43c3bff9f70ad661d638. Resources: {'ram', 'cores', 'instances'} {{(pid=117831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:40:52.542935 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-401e2c3e-6981-4054-aeb8-a7acac508f4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Going to run 1 instances... {{(pid=117831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 10:40:52.545085 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-401e2c3e-6981-4054-aeb8-a7acac508f4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7aef519f-76cb-4dbd-ba5b-5fa2f6b86fb3',volume_size=None,volume_type=None)] {{(pid=117831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 10:40:52.692443 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-401e2c3e-6981-4054-aeb8-a7acac508f4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.771166 Aug 05 10:40:52.693315 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 593/1211] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 10:40:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 10:40:52.704229 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-94317890-2fb3-440c-80cd-4539df29d4df tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:40:52.705027 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-94317890-2fb3-440c-80cd-4539df29d4df tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:40:52.708660 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=4 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:40:52.712330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:40:52.772620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-94317890-2fb3-440c-80cd-4539df29d4df tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:40:52.779844 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-94317890-2fb3-440c-80cd-4539df29d4df tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d" status: 200 len: 1094 microversion: 2.1 time: 0.079556 Aug 05 10:40:52.780426 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 619/1212] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:40:52 2022] GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:40:53.801505 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-cdb8fc0d-8247-4afe-9708-30d27316a7f8 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:40:53.802972 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-cdb8fc0d-8247-4afe-9708-30d27316a7f8 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:40:53.810951 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cdb8fc0d-8247-4afe-9708-30d27316a7f8 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:40:53.811997 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cdb8fc0d-8247-4afe-9708-30d27316a7f8 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:40:53.812569 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cdb8fc0d-8247-4afe-9708-30d27316a7f8 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:40:53.813852 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cdb8fc0d-8247-4afe-9708-30d27316a7f8 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:40:53.814392 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cdb8fc0d-8247-4afe-9708-30d27316a7f8 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:40:53.814927 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cdb8fc0d-8247-4afe-9708-30d27316a7f8 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:40:53.892698 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-cdb8fc0d-8247-4afe-9708-30d27316a7f8 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:40:53.900953 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-cdb8fc0d-8247-4afe-9708-30d27316a7f8 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d" status: 200 len: 1210 microversion: 2.1 time: 0.104433 Aug 05 10:40:53.901699 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 594/1213] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:40:53 2022] GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d => generated 1210 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:40:54.923116 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-060fd916-f3f2-442e-b56e-38969bf4e916 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:40:54.923824 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-060fd916-f3f2-442e-b56e-38969bf4e916 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:40:54.930394 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-060fd916-f3f2-442e-b56e-38969bf4e916 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:40:54.930993 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-060fd916-f3f2-442e-b56e-38969bf4e916 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:40:54.931494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-060fd916-f3f2-442e-b56e-38969bf4e916 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:40:54.932278 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-060fd916-f3f2-442e-b56e-38969bf4e916 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:40:54.932803 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-060fd916-f3f2-442e-b56e-38969bf4e916 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:40:54.933295 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-060fd916-f3f2-442e-b56e-38969bf4e916 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:40:55.066924 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-060fd916-f3f2-442e-b56e-38969bf4e916 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:40:55.075030 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-060fd916-f3f2-442e-b56e-38969bf4e916 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d" status: 200 len: 1265 microversion: 2.1 time: 0.156059 Aug 05 10:40:55.075603 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 620/1214] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:40:54 2022] GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:40:55.157944 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-939d0b2c-94c4-4874-a03b-28ec8517667b req-1c7fd24d-40a2-4b90-9528-2971c0be245c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9532b6a6-a794-4537-86b2-97bfe520ff7d", "tag": "3958ff37-8b9d-48d5-8752-3c2fc0507340"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:40:55.171166 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-939d0b2c-94c4-4874-a03b-28ec8517667b req-1c7fd24d-40a2-4b90-9528-2971c0be245c service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:40:55.172301 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-939d0b2c-94c4-4874-a03b-28ec8517667b req-1c7fd24d-40a2-4b90-9528-2971c0be245c service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:40:55.172977 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-939d0b2c-94c4-4874-a03b-28ec8517667b req-1c7fd24d-40a2-4b90-9528-2971c0be245c service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:40:55.185292 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-939d0b2c-94c4-4874-a03b-28ec8517667b req-1c7fd24d-40a2-4b90-9528-2971c0be245c service nova] Creating event network-changed:3958ff37-8b9d-48d5-8752-3c2fc0507340 for instance 9532b6a6-a794-4537-86b2-97bfe520ff7d on hv-cinder-81558 Aug 05 10:40:55.190586 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-939d0b2c-94c4-4874-a03b-28ec8517667b req-1c7fd24d-40a2-4b90-9528-2971c0be245c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042611 Aug 05 10:40:55.191367 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 595/1215] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:40:56.098422 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6fb0d4a1-9ac6-43c4-b0b8-9bf315762679 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:40:56.099207 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6fb0d4a1-9ac6-43c4-b0b8-9bf315762679 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:40:56.107653 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fb0d4a1-9ac6-43c4-b0b8-9bf315762679 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:40:56.108300 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fb0d4a1-9ac6-43c4-b0b8-9bf315762679 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:40:56.108876 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fb0d4a1-9ac6-43c4-b0b8-9bf315762679 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:40:56.109847 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fb0d4a1-9ac6-43c4-b0b8-9bf315762679 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:40:56.110306 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fb0d4a1-9ac6-43c4-b0b8-9bf315762679 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:40:56.110733 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6fb0d4a1-9ac6-43c4-b0b8-9bf315762679 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:40:56.263684 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6fb0d4a1-9ac6-43c4-b0b8-9bf315762679 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:40:56.272260 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6fb0d4a1-9ac6-43c4-b0b8-9bf315762679 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d" status: 200 len: 1265 microversion: 2.1 time: 0.179224 Aug 05 10:40:56.272832 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 621/1216] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:40:56 2022] GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:40:57.298752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-62080544-1101-4d4e-bf9c-a02685b01d66 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:40:57.300045 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-62080544-1101-4d4e-bf9c-a02685b01d66 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:40:57.310686 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-62080544-1101-4d4e-bf9c-a02685b01d66 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:40:57.311523 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-62080544-1101-4d4e-bf9c-a02685b01d66 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:40:57.312419 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-62080544-1101-4d4e-bf9c-a02685b01d66 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:40:57.313601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-62080544-1101-4d4e-bf9c-a02685b01d66 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:40:57.314174 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-62080544-1101-4d4e-bf9c-a02685b01d66 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:40:57.314601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-62080544-1101-4d4e-bf9c-a02685b01d66 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:40:57.467546 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-62080544-1101-4d4e-bf9c-a02685b01d66 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:40:57.475687 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-62080544-1101-4d4e-bf9c-a02685b01d66 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d" status: 200 len: 1265 microversion: 2.1 time: 0.185145 Aug 05 10:40:57.476241 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 596/1217] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:40:57 2022] GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:40:58.497916 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3383b479-3bf4-45c2-880e-80c5fb590fd2 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:40:58.499017 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3383b479-3bf4-45c2-880e-80c5fb590fd2 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:40:58.507688 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3383b479-3bf4-45c2-880e-80c5fb590fd2 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:40:58.508454 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3383b479-3bf4-45c2-880e-80c5fb590fd2 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:40:58.509160 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3383b479-3bf4-45c2-880e-80c5fb590fd2 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:40:58.510268 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3383b479-3bf4-45c2-880e-80c5fb590fd2 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:40:58.511055 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3383b479-3bf4-45c2-880e-80c5fb590fd2 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:40:58.511738 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3383b479-3bf4-45c2-880e-80c5fb590fd2 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:40:58.653424 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3383b479-3bf4-45c2-880e-80c5fb590fd2 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:40:58.664961 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3383b479-3bf4-45c2-880e-80c5fb590fd2 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d" status: 200 len: 1265 microversion: 2.1 time: 0.171825 Aug 05 10:40:58.665710 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 622/1218] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:40:58 2022] GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:40:59.692922 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-f52c1787-9f10-4dc2-8b59-7a828b8afec5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:40:59.693820 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-f52c1787-9f10-4dc2-8b59-7a828b8afec5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:40:59.704650 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f52c1787-9f10-4dc2-8b59-7a828b8afec5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:40:59.705448 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f52c1787-9f10-4dc2-8b59-7a828b8afec5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:40:59.706157 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f52c1787-9f10-4dc2-8b59-7a828b8afec5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:40:59.707383 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f52c1787-9f10-4dc2-8b59-7a828b8afec5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:40:59.708160 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f52c1787-9f10-4dc2-8b59-7a828b8afec5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:40:59.708858 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-f52c1787-9f10-4dc2-8b59-7a828b8afec5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:40:59.842868 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-f52c1787-9f10-4dc2-8b59-7a828b8afec5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:40:59.852565 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-f52c1787-9f10-4dc2-8b59-7a828b8afec5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d" status: 200 len: 1265 microversion: 2.1 time: 0.166957 Aug 05 10:40:59.853134 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 597/1219] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:40:59 2022] GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:41:00.877949 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-32b32b29-70be-445a-b11c-6c002a46d050 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:41:00.878926 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-32b32b29-70be-445a-b11c-6c002a46d050 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:41:00.889963 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-32b32b29-70be-445a-b11c-6c002a46d050 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:41:00.890758 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-32b32b29-70be-445a-b11c-6c002a46d050 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:41:00.891229 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-32b32b29-70be-445a-b11c-6c002a46d050 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:41:00.891933 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-32b32b29-70be-445a-b11c-6c002a46d050 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:41:00.892384 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-32b32b29-70be-445a-b11c-6c002a46d050 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:41:00.892811 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-32b32b29-70be-445a-b11c-6c002a46d050 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:41:01.030117 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-32b32b29-70be-445a-b11c-6c002a46d050 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:41:01.038325 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-32b32b29-70be-445a-b11c-6c002a46d050 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d" status: 200 len: 1265 microversion: 2.1 time: 0.167337 Aug 05 10:41:01.038882 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 623/1220] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:41:00 2022] GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:41:02.064204 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-158c7d6a-d190-4fa0-a54d-e7c3ead8da69 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:41:02.065133 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-158c7d6a-d190-4fa0-a54d-e7c3ead8da69 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:41:02.076120 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-158c7d6a-d190-4fa0-a54d-e7c3ead8da69 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:41:02.076913 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-158c7d6a-d190-4fa0-a54d-e7c3ead8da69 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:41:02.077625 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-158c7d6a-d190-4fa0-a54d-e7c3ead8da69 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:41:02.078857 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-158c7d6a-d190-4fa0-a54d-e7c3ead8da69 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:41:02.079369 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-158c7d6a-d190-4fa0-a54d-e7c3ead8da69 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:41:02.079789 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-158c7d6a-d190-4fa0-a54d-e7c3ead8da69 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:41:02.218758 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-158c7d6a-d190-4fa0-a54d-e7c3ead8da69 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:41:02.231421 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-158c7d6a-d190-4fa0-a54d-e7c3ead8da69 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d" status: 200 len: 1265 microversion: 2.1 time: 0.174036 Aug 05 10:41:02.232345 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 598/1221] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:41:02 2022] GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:41:03.257719 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-80b8e241-e393-46b2-8afc-5cd7230c54e0 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:41:03.258710 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-80b8e241-e393-46b2-8afc-5cd7230c54e0 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:41:03.262399 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:41:03.271775 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-80b8e241-e393-46b2-8afc-5cd7230c54e0 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:41:03.272557 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-80b8e241-e393-46b2-8afc-5cd7230c54e0 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:41:03.273268 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-80b8e241-e393-46b2-8afc-5cd7230c54e0 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:41:03.274387 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-80b8e241-e393-46b2-8afc-5cd7230c54e0 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:41:03.275201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-80b8e241-e393-46b2-8afc-5cd7230c54e0 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:41:03.275898 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-80b8e241-e393-46b2-8afc-5cd7230c54e0 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:41:03.416359 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-80b8e241-e393-46b2-8afc-5cd7230c54e0 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:41:03.427039 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-80b8e241-e393-46b2-8afc-5cd7230c54e0 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d" status: 200 len: 1265 microversion: 2.1 time: 0.176642 Aug 05 10:41:03.427611 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 624/1222] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:41:03 2022] GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:41:04.455491 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-524cbabe-00ee-457b-889b-bbe5c819d581 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:41:04.456092 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-524cbabe-00ee-457b-889b-bbe5c819d581 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:41:04.458003 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=2 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:41:04.458716 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=6 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:41:04.465685 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-524cbabe-00ee-457b-889b-bbe5c819d581 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:41:04.466179 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-524cbabe-00ee-457b-889b-bbe5c819d581 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:41:04.466618 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-524cbabe-00ee-457b-889b-bbe5c819d581 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:41:04.467352 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-524cbabe-00ee-457b-889b-bbe5c819d581 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:41:04.467806 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-524cbabe-00ee-457b-889b-bbe5c819d581 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:41:04.468228 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-524cbabe-00ee-457b-889b-bbe5c819d581 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:41:04.605401 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-524cbabe-00ee-457b-889b-bbe5c819d581 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:41:04.613740 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-524cbabe-00ee-457b-889b-bbe5c819d581 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d" status: 200 len: 1265 microversion: 2.1 time: 0.168342 Aug 05 10:41:04.614297 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 599/1223] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:41:04 2022] GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:41:05.636602 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-aca5fffb-4583-45ef-8dc8-8192e3d3c866 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:41:05.637305 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-aca5fffb-4583-45ef-8dc8-8192e3d3c866 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:41:05.644421 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aca5fffb-4583-45ef-8dc8-8192e3d3c866 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:41:05.644870 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aca5fffb-4583-45ef-8dc8-8192e3d3c866 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:41:05.645321 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aca5fffb-4583-45ef-8dc8-8192e3d3c866 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:41:05.646005 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aca5fffb-4583-45ef-8dc8-8192e3d3c866 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:41:05.646448 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aca5fffb-4583-45ef-8dc8-8192e3d3c866 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:41:05.646861 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aca5fffb-4583-45ef-8dc8-8192e3d3c866 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:41:05.751983 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-af1d9ccf-930b-4655-8ee8-6cd8b04fe255 req-afbf34f5-53bf-4de3-93b4-624dee51f8df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9532b6a6-a794-4537-86b2-97bfe520ff7d", "name": "network-vif-plugged", "status": "completed", "tag": "3958ff37-8b9d-48d5-8752-3c2fc0507340"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:41:05.764330 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-af1d9ccf-930b-4655-8ee8-6cd8b04fe255 req-afbf34f5-53bf-4de3-93b4-624dee51f8df service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:41:05.764674 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-af1d9ccf-930b-4655-8ee8-6cd8b04fe255 req-afbf34f5-53bf-4de3-93b4-624dee51f8df service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:41:05.765123 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-af1d9ccf-930b-4655-8ee8-6cd8b04fe255 req-afbf34f5-53bf-4de3-93b4-624dee51f8df service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:41:05.777172 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-af1d9ccf-930b-4655-8ee8-6cd8b04fe255 req-afbf34f5-53bf-4de3-93b4-624dee51f8df service nova] Creating event network-vif-plugged:3958ff37-8b9d-48d5-8752-3c2fc0507340 for instance 9532b6a6-a794-4537-86b2-97bfe520ff7d on hv-cinder-81558 Aug 05 10:41:05.781252 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-aca5fffb-4583-45ef-8dc8-8192e3d3c866 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:41:05.782307 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-af1d9ccf-930b-4655-8ee8-6cd8b04fe255 req-afbf34f5-53bf-4de3-93b4-624dee51f8df service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034666 Aug 05 10:41:05.783305 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 600/1224] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:41:05.789259 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-aca5fffb-4583-45ef-8dc8-8192e3d3c866 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d" status: 200 len: 1265 microversion: 2.1 time: 0.157139 Aug 05 10:41:05.789763 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 625/1225] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:41:05 2022] GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:41:06.813725 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-0cc0df1e-3bf4-4999-872f-e74c6a55f413 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:41:06.814657 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-0cc0df1e-3bf4-4999-872f-e74c6a55f413 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:41:06.823338 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0cc0df1e-3bf4-4999-872f-e74c6a55f413 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:41:06.823980 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0cc0df1e-3bf4-4999-872f-e74c6a55f413 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:41:06.824693 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0cc0df1e-3bf4-4999-872f-e74c6a55f413 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:41:06.825606 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0cc0df1e-3bf4-4999-872f-e74c6a55f413 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:41:06.826210 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0cc0df1e-3bf4-4999-872f-e74c6a55f413 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:41:06.826807 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0cc0df1e-3bf4-4999-872f-e74c6a55f413 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:41:06.967935 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-0cc0df1e-3bf4-4999-872f-e74c6a55f413 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:41:06.975922 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-0cc0df1e-3bf4-4999-872f-e74c6a55f413 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d" status: 200 len: 1265 microversion: 2.1 time: 0.168997 Aug 05 10:41:06.976465 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 601/1226] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:41:06 2022] GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:41:08.000238 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b8dece3e-1657-4514-93bb-d1c1d3f2220c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:41:08.001353 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b8dece3e-1657-4514-93bb-d1c1d3f2220c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:41:08.008537 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b8dece3e-1657-4514-93bb-d1c1d3f2220c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:41:08.009054 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b8dece3e-1657-4514-93bb-d1c1d3f2220c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:41:08.009501 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b8dece3e-1657-4514-93bb-d1c1d3f2220c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:41:08.010221 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b8dece3e-1657-4514-93bb-d1c1d3f2220c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:41:08.010688 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b8dece3e-1657-4514-93bb-d1c1d3f2220c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:41:08.011165 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b8dece3e-1657-4514-93bb-d1c1d3f2220c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:41:08.150880 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b8dece3e-1657-4514-93bb-d1c1d3f2220c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:41:08.159725 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b8dece3e-1657-4514-93bb-d1c1d3f2220c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d" status: 200 len: 1453 microversion: 2.1 time: 0.165449 Aug 05 10:41:08.160306 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 626/1227] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:41:07 2022] GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:41:08.184105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-cbea42d7-44a3-4598-985b-d0a91533b8c3 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:41:08.184660 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-cbea42d7-44a3-4598-985b-d0a91533b8c3 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:41:08.191503 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cbea42d7-44a3-4598-985b-d0a91533b8c3 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:41:08.191977 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cbea42d7-44a3-4598-985b-d0a91533b8c3 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:41:08.192406 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cbea42d7-44a3-4598-985b-d0a91533b8c3 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:41:08.193095 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cbea42d7-44a3-4598-985b-d0a91533b8c3 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:41:08.193543 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cbea42d7-44a3-4598-985b-d0a91533b8c3 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:41:08.193961 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cbea42d7-44a3-4598-985b-d0a91533b8c3 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:41:08.331776 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-cbea42d7-44a3-4598-985b-d0a91533b8c3 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:41:08.339846 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-cbea42d7-44a3-4598-985b-d0a91533b8c3 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d" status: 200 len: 1453 microversion: 2.1 time: 0.159629 Aug 05 10:41:08.340414 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 602/1228] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:41:08 2022] GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:41:10.399843 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-42d5a5ee-4046-4d84-bb70-2f4fbc1d0770 req-eeac767e-ae5b-41ff-a5f0-a00659e424b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9532b6a6-a794-4537-86b2-97bfe520ff7d", "tag": "3958ff37-8b9d-48d5-8752-3c2fc0507340"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:41:10.410145 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-42d5a5ee-4046-4d84-bb70-2f4fbc1d0770 req-eeac767e-ae5b-41ff-a5f0-a00659e424b8 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:41:10.410609 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-42d5a5ee-4046-4d84-bb70-2f4fbc1d0770 req-eeac767e-ae5b-41ff-a5f0-a00659e424b8 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:41:10.411056 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-42d5a5ee-4046-4d84-bb70-2f4fbc1d0770 req-eeac767e-ae5b-41ff-a5f0-a00659e424b8 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:41:10.422612 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-42d5a5ee-4046-4d84-bb70-2f4fbc1d0770 req-eeac767e-ae5b-41ff-a5f0-a00659e424b8 service nova] Creating event network-changed:3958ff37-8b9d-48d5-8752-3c2fc0507340 for instance 9532b6a6-a794-4537-86b2-97bfe520ff7d on hv-cinder-81558 Aug 05 10:41:10.427827 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-42d5a5ee-4046-4d84-bb70-2f4fbc1d0770 req-eeac767e-ae5b-41ff-a5f0-a00659e424b8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032123 Aug 05 10:41:10.428414 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 627/1229] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:41:27.887399 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 10:41:27.888454 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Fri Aug 5 10:41:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 10:41:30.114451 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 10:41:30.115511 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Fri Aug 5 10:41:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 10:42:54.005330 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 10:42:54.005928 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Fri Aug 5 10:42:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 10:43:24.060350 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:43:24.061137 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=48 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:43:24.065915 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-79a58b2e-fc86-4a51-a1b2-504fbc27079d tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:43:24.066461 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-79a58b2e-fc86-4a51-a1b2-504fbc27079d tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:43:24.074318 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-79a58b2e-fc86-4a51-a1b2-504fbc27079d tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:24.074844 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-79a58b2e-fc86-4a51-a1b2-504fbc27079d tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:24.075357 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-79a58b2e-fc86-4a51-a1b2-504fbc27079d tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:24.076122 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-79a58b2e-fc86-4a51-a1b2-504fbc27079d tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:24.076657 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-79a58b2e-fc86-4a51-a1b2-504fbc27079d tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:24.077118 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-79a58b2e-fc86-4a51-a1b2-504fbc27079d tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:24.105260 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-79a58b2e-fc86-4a51-a1b2-504fbc27079d tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] Going to try to terminate instance {{(pid=117831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 10:43:24.193367 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-79a58b2e-fc86-4a51-a1b2-504fbc27079d tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d" status: 204 len: 0 microversion: 2.1 time: 0.134756 Aug 05 10:43:24.193900 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 603/1230] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:43:24 2022] DELETE /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:43:24.200979 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8ecb9fd0-0620-4550-9791-01d00e981287] AMQP server on 10.222.0.40:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 05 10:43:24.202165 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=20 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:43:24.202930 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=44 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:43:24.207481 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f7dbe8c8-b8f7-4468-adbe-0bc1a2130fb0 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:43:24.208168 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f7dbe8c8-b8f7-4468-adbe-0bc1a2130fb0 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:43:24.215084 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7dbe8c8-b8f7-4468-adbe-0bc1a2130fb0 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:24.215554 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7dbe8c8-b8f7-4468-adbe-0bc1a2130fb0 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:24.215980 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7dbe8c8-b8f7-4468-adbe-0bc1a2130fb0 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:24.216659 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7dbe8c8-b8f7-4468-adbe-0bc1a2130fb0 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:24.217102 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7dbe8c8-b8f7-4468-adbe-0bc1a2130fb0 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:24.217513 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7dbe8c8-b8f7-4468-adbe-0bc1a2130fb0 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:24.412058 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f7dbe8c8-b8f7-4468-adbe-0bc1a2130fb0 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:43:24.420022 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f7dbe8c8-b8f7-4468-adbe-0bc1a2130fb0 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d" status: 200 len: 1577 microversion: 2.1 time: 0.220950 Aug 05 10:43:24.420582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 628/1231] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:43:24 2022] GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d => generated 1577 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:43:25.445716 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-7c7f0f84-0d06-4f8b-a435-73d356499d27 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:43:25.446780 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-7c7f0f84-0d06-4f8b-a435-73d356499d27 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:43:25.457807 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7c7f0f84-0d06-4f8b-a435-73d356499d27 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:25.458597 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7c7f0f84-0d06-4f8b-a435-73d356499d27 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:25.459366 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7c7f0f84-0d06-4f8b-a435-73d356499d27 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:25.460495 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7c7f0f84-0d06-4f8b-a435-73d356499d27 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:25.461250 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7c7f0f84-0d06-4f8b-a435-73d356499d27 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:25.461938 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-7c7f0f84-0d06-4f8b-a435-73d356499d27 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:25.673686 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-7c7f0f84-0d06-4f8b-a435-73d356499d27 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:43:25.682171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-7c7f0f84-0d06-4f8b-a435-73d356499d27 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d" status: 200 len: 1577 microversion: 2.1 time: 0.243792 Aug 05 10:43:25.682738 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 604/1232] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:43:25 2022] GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d => generated 1577 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:43:26.703426 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-674deb4e-fb0a-4376-85e1-4366598ff035 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:43:26.704645 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-674deb4e-fb0a-4376-85e1-4366598ff035 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:43:26.713158 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-674deb4e-fb0a-4376-85e1-4366598ff035 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:26.713643 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-674deb4e-fb0a-4376-85e1-4366598ff035 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:26.714076 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-674deb4e-fb0a-4376-85e1-4366598ff035 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:26.714782 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-674deb4e-fb0a-4376-85e1-4366598ff035 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:26.715283 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-674deb4e-fb0a-4376-85e1-4366598ff035 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:26.715708 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-674deb4e-fb0a-4376-85e1-4366598ff035 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:26.735564 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] [8ecb9fd0-0620-4550-9791-01d00e981287] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 49618. Aug 05 10:43:26.853801 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-674deb4e-fb0a-4376-85e1-4366598ff035 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:43:26.861907 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-674deb4e-fb0a-4376-85e1-4366598ff035 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d" status: 200 len: 1577 microversion: 2.1 time: 0.162536 Aug 05 10:43:26.862502 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 629/1233] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:43:26 2022] GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:43:27.268491 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-675b1455-4284-4aa9-91c3-27bc38d79d94 req-2c5ce105-fdbb-4b11-907c-33f808841f27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9532b6a6-a794-4537-86b2-97bfe520ff7d", "name": "network-vif-deleted", "tag": "3958ff37-8b9d-48d5-8752-3c2fc0507340"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:43:27.279394 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-675b1455-4284-4aa9-91c3-27bc38d79d94 req-2c5ce105-fdbb-4b11-907c-33f808841f27 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:27.279794 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-675b1455-4284-4aa9-91c3-27bc38d79d94 req-2c5ce105-fdbb-4b11-907c-33f808841f27 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:27.280228 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-675b1455-4284-4aa9-91c3-27bc38d79d94 req-2c5ce105-fdbb-4b11-907c-33f808841f27 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:27.292204 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-675b1455-4284-4aa9-91c3-27bc38d79d94 req-2c5ce105-fdbb-4b11-907c-33f808841f27 service nova] Creating event network-vif-deleted:3958ff37-8b9d-48d5-8752-3c2fc0507340 for instance 9532b6a6-a794-4537-86b2-97bfe520ff7d on hv-cinder-81558 Aug 05 10:43:27.298169 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-675b1455-4284-4aa9-91c3-27bc38d79d94 req-2c5ce105-fdbb-4b11-907c-33f808841f27 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105983 Aug 05 10:43:27.298775 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 605/1234] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:43:27.883486 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9d3d59e2-b6c7-4f6e-93e9-d4c2dbe08ca1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:43:27.884061 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9d3d59e2-b6c7-4f6e-93e9-d4c2dbe08ca1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:43:27.891000 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9d3d59e2-b6c7-4f6e-93e9-d4c2dbe08ca1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:27.891477 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9d3d59e2-b6c7-4f6e-93e9-d4c2dbe08ca1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:27.891912 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9d3d59e2-b6c7-4f6e-93e9-d4c2dbe08ca1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:27.892605 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9d3d59e2-b6c7-4f6e-93e9-d4c2dbe08ca1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:27.893058 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9d3d59e2-b6c7-4f6e-93e9-d4c2dbe08ca1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:27.893477 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9d3d59e2-b6c7-4f6e-93e9-d4c2dbe08ca1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:27.932010 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9d3d59e2-b6c7-4f6e-93e9-d4c2dbe08ca1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:27.932594 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9d3d59e2-b6c7-4f6e-93e9-d4c2dbe08ca1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:27.932928 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9d3d59e2-b6c7-4f6e-93e9-d4c2dbe08ca1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:27.933372 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-9d3d59e2-b6c7-4f6e-93e9-d4c2dbe08ca1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lazy-loading 'fault' on Instance uuid 9532b6a6-a794-4537-86b2-97bfe520ff7d {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:43:27.979493 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9d3d59e2-b6c7-4f6e-93e9-d4c2dbe08ca1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:43:27.987760 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9d3d59e2-b6c7-4f6e-93e9-d4c2dbe08ca1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d" status: 200 len: 1230 microversion: 2.1 time: 0.108247 Aug 05 10:43:27.988319 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 630/1235] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:43:27 2022] GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d => generated 1230 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:43:29.011567 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d69143cb-1c38-4454-94a1-2cd4ed3a9773 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:43:29.012254 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-d69143cb-1c38-4454-94a1-2cd4ed3a9773 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:43:29.019913 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d69143cb-1c38-4454-94a1-2cd4ed3a9773 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:29.020421 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d69143cb-1c38-4454-94a1-2cd4ed3a9773 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:29.020895 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d69143cb-1c38-4454-94a1-2cd4ed3a9773 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:29.021639 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d69143cb-1c38-4454-94a1-2cd4ed3a9773 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:29.022114 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d69143cb-1c38-4454-94a1-2cd4ed3a9773 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:29.022573 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-d69143cb-1c38-4454-94a1-2cd4ed3a9773 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:29.040010 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-d69143cb-1c38-4454-94a1-2cd4ed3a9773 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] HTTP exception thrown: Instance 9532b6a6-a794-4537-86b2-97bfe520ff7d could not be found. Aug 05 10:43:29.041623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d69143cb-1c38-4454-94a1-2cd4ed3a9773 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Request method failure captured: Aug 05 10:43:29.041623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d HTTP/1.1 Aug 05 10:43:29.041623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:43:29.041623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:43:29.041623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:43:29.041623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:43:29.041623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:43:29.041623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:43:29.041623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:43:29.041623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:43:29.041623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7POZFyPpyqoE5xtedlrqJm7BhRjqbV-H8xq8zBKEX-42ITmlI2JqJZfhJ5dndOnOITqhLrKNr91y4t4vKMjwDl3L9-pCFcHAV6VD-L1dI1D9RSDVrIEF_pXCxxBKmkqS1w6CJNBlBPXQw3SfMWhQ9v5plEp_Ms9GRpK4rGOBNJJ5944 Aug 05 10:43:29.041623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:43:29.041623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:43:29.041623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:43:29.041623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:43:29.041623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:43:29.041623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:43:29.041623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 28cf7e20408a43c3bff9f70ad661d638 Aug 05 10:43:29.041623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-TestVolumeBootPattern-573262870 Aug 05 10:43:29.041623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:43:29.041623 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:43:29.043378 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_28cf7e20408a43c3bff9f70ad661d638"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/28cf7e20408a43c3bff9f70ad661d638"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/28cf7e20408a43c3bff9f70ad661d638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/28cf7e20408a43c3bff9f70ad661d638"}]}] Aug 05 10:43:29.043378 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-TestVolumeBootPattern-573262870 Aug 05 10:43:29.043378 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 28cf7e20408a43c3bff9f70ad661d638 Aug 05 10:43:29.043378 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-TestVolumeBootPattern-573262870 Aug 05 10:43:29.043378 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-TestVolumeBootPattern-573262870-project Aug 05 10:43:29.043378 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:43:29.043378 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:43:29.043378 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: c93e81531ea54583b11f5a6c107c9166 Aug 05 10:43:29.043378 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-TestVolumeBootPattern-573262870-project Aug 05 10:43:29.043378 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: > Aug 05 10:43:29.043378 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Instance 9532b6a6-a794-4537-86b2-97bfe520ff7d could not be found. Aug 05 10:43:29.043378 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'id': '9532b6a6-a794-4537-86b2-97bfe520ff7d'} Aug 05 10:43:29.045646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:43:29.045646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:43:29.045646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:43:29.045646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:43:29.045646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:43:29.045646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:43:29.045646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:43:29.045646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:43:29.045646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:43:29.045646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:43:29.045646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9532b6a6-a794-4537-86b2-97bfe520ff7d could not be found. Aug 05 10:43:29.045646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:43:29.045646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:43:29.045646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:43:29.045646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:43:29.045646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:43:29.045646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:43:29.045646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:43:29.045646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:43:29.045646 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:43:29.047317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:43:29.047317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:43:29.047317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:43:29.047317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:43:29.047317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:43:29.047317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:43:29.047317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:43:29.047317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9532b6a6-a794-4537-86b2-97bfe520ff7d could not be found. Aug 05 10:43:29.047317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:43:29.047317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:43:29.047317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:43:29.047317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:43:29.047317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:43:29.047317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:43:29.047317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:43:29.047317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:43:29.047317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9532b6a6-a794-4537-86b2-97bfe520ff7d could not be found. Aug 05 10:43:29.047317 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:43:29.048824 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-d69143cb-1c38-4454-94a1-2cd4ed3a9773 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Returning 404 to user: Instance 9532b6a6-a794-4537-86b2-97bfe520ff7d could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:43:29.048824 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-d69143cb-1c38-4454-94a1-2cd4ed3a9773 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d" status: 404 len: 111 microversion: 2.1 time: 0.036767 Aug 05 10:43:29.048824 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 606/1236] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:43:29 2022] GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:43:29.094763 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9daa95ef-c4aa-4625-beda-4f93788f26f5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1678850152", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1855561432", "security_groups": [{"name": "tempest-secgroup-smoke-116129686"}], "block_device_mapping_v2": [{"uuid": "7aef519f-76cb-4dbd-ba5b-5fa2f6b86fb3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "96bc74ca-f39c-4f14-b9e3-8c46e8c7690b"}]}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:43:29.222447 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-9daa95ef-c4aa-4625-beda-4f93788f26f5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] validate_networks() for [('96bc74ca-f39c-4f14-b9e3-8c46e8c7690b', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 10:43:29.676867 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-9daa95ef-c4aa-4625-beda-4f93788f26f5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 10:43:29.677455 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-9daa95ef-c4aa-4625-beda-4f93788f26f5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 10:43:29.678094 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-9daa95ef-c4aa-4625-beda-4f93788f26f5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 10:43:29.678819 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-9daa95ef-c4aa-4625-beda-4f93788f26f5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 10:43:29.679404 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-9daa95ef-c4aa-4625-beda-4f93788f26f5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 10:43:29.693915 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9daa95ef-c4aa-4625-beda-4f93788f26f5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:29.694565 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9daa95ef-c4aa-4625-beda-4f93788f26f5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:29.695227 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9daa95ef-c4aa-4625-beda-4f93788f26f5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:29.696310 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9daa95ef-c4aa-4625-beda-4f93788f26f5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:29.696864 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9daa95ef-c4aa-4625-beda-4f93788f26f5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:29.697287 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9daa95ef-c4aa-4625-beda-4f93788f26f5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:29.716116 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-9daa95ef-c4aa-4625-beda-4f93788f26f5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Getting quotas for project 28cf7e20408a43c3bff9f70ad661d638. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:43:29.720726 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-9daa95ef-c4aa-4625-beda-4f93788f26f5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Getting quotas for user c93e81531ea54583b11f5a6c107c9166 and project 28cf7e20408a43c3bff9f70ad661d638. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:43:29.785245 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9daa95ef-c4aa-4625-beda-4f93788f26f5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 10:43:29.787435 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9daa95ef-c4aa-4625-beda-4f93788f26f5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 0c898cc8-5c65-42eb-839e-4022a1dd965a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7aef519f-76cb-4dbd-ba5b-5fa2f6b86fb3',volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 10:43:29.926051 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9daa95ef-c4aa-4625-beda-4f93788f26f5 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.837599 Aug 05 10:43:29.926588 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 631/1237] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 10:43:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 10:43:29.937492 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-a6cc1194-6346-4edf-9a69-43730b36d74c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:43:29.938105 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-a6cc1194-6346-4edf-9a69-43730b36d74c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 0c898cc8-5c65-42eb-839e-4022a1dd965a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:43:29.999728 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-a6cc1194-6346-4edf-9a69-43730b36d74c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:43:30.007483 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-a6cc1194-6346-4edf-9a69-43730b36d74c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a" status: 200 len: 1095 microversion: 2.1 time: 0.073843 Aug 05 10:43:30.008048 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 607/1238] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:43:29 2022] GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:43:31.028089 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-82c9634b-18e5-4d52-931a-1df25183e942 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:43:31.028891 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-82c9634b-18e5-4d52-931a-1df25183e942 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 0c898cc8-5c65-42eb-839e-4022a1dd965a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:43:31.035584 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-82c9634b-18e5-4d52-931a-1df25183e942 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:31.036076 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-82c9634b-18e5-4d52-931a-1df25183e942 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:31.036511 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-82c9634b-18e5-4d52-931a-1df25183e942 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:31.037214 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-82c9634b-18e5-4d52-931a-1df25183e942 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:31.037702 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-82c9634b-18e5-4d52-931a-1df25183e942 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:31.038107 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-82c9634b-18e5-4d52-931a-1df25183e942 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:31.100114 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-82c9634b-18e5-4d52-931a-1df25183e942 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:43:31.108307 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-82c9634b-18e5-4d52-931a-1df25183e942 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a" status: 200 len: 1145 microversion: 2.1 time: 0.084087 Aug 05 10:43:31.108770 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 632/1239] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:43:31 2022] GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:43:32.129981 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-15f58dea-3bea-4b09-84e1-0c220ed63dfc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:43:32.130566 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-15f58dea-3bea-4b09-84e1-0c220ed63dfc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 0c898cc8-5c65-42eb-839e-4022a1dd965a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:43:32.139705 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-15f58dea-3bea-4b09-84e1-0c220ed63dfc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:32.140227 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-15f58dea-3bea-4b09-84e1-0c220ed63dfc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:32.140689 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-15f58dea-3bea-4b09-84e1-0c220ed63dfc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:32.141683 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-15f58dea-3bea-4b09-84e1-0c220ed63dfc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:32.142118 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-15f58dea-3bea-4b09-84e1-0c220ed63dfc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:32.142785 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-15f58dea-3bea-4b09-84e1-0c220ed63dfc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:32.236958 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-15f58dea-3bea-4b09-84e1-0c220ed63dfc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:43:32.245998 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-15f58dea-3bea-4b09-84e1-0c220ed63dfc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a" status: 200 len: 1201 microversion: 2.1 time: 0.120242 Aug 05 10:43:32.246560 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 608/1240] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:43:32 2022] GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a => generated 1201 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:43:33.267390 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dba84df3-ccca-434e-90a1-b54b9201c4be tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:43:33.268114 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dba84df3-ccca-434e-90a1-b54b9201c4be tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 0c898cc8-5c65-42eb-839e-4022a1dd965a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:43:33.275026 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dba84df3-ccca-434e-90a1-b54b9201c4be tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:33.275550 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dba84df3-ccca-434e-90a1-b54b9201c4be tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:33.275988 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dba84df3-ccca-434e-90a1-b54b9201c4be tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:33.276693 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dba84df3-ccca-434e-90a1-b54b9201c4be tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:33.277361 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dba84df3-ccca-434e-90a1-b54b9201c4be tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:33.277783 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dba84df3-ccca-434e-90a1-b54b9201c4be tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:33.431628 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dba84df3-ccca-434e-90a1-b54b9201c4be tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:43:33.439658 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dba84df3-ccca-434e-90a1-b54b9201c4be tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a" status: 200 len: 1266 microversion: 2.1 time: 0.176298 Aug 05 10:43:33.440270 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 633/1241] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:43:33 2022] GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:43:33.508609 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-4d21a27d-6742-4fae-9c3c-38c8cdc7008b req-2794fc6c-2cdc-4019-8409-d6404a7fd356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c898cc8-5c65-42eb-839e-4022a1dd965a", "tag": "eabd1b40-e101-4364-a3a5-8d15430db18b"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:43:33.518778 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-4d21a27d-6742-4fae-9c3c-38c8cdc7008b req-2794fc6c-2cdc-4019-8409-d6404a7fd356 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:33.519241 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-4d21a27d-6742-4fae-9c3c-38c8cdc7008b req-2794fc6c-2cdc-4019-8409-d6404a7fd356 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:33.519708 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-4d21a27d-6742-4fae-9c3c-38c8cdc7008b req-2794fc6c-2cdc-4019-8409-d6404a7fd356 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:33.532533 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-4d21a27d-6742-4fae-9c3c-38c8cdc7008b req-2794fc6c-2cdc-4019-8409-d6404a7fd356 service nova] Creating event network-changed:eabd1b40-e101-4364-a3a5-8d15430db18b for instance 0c898cc8-5c65-42eb-839e-4022a1dd965a on hv-cinder-81558 Aug 05 10:43:33.537560 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-4d21a27d-6742-4fae-9c3c-38c8cdc7008b req-2794fc6c-2cdc-4019-8409-d6404a7fd356 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033783 Aug 05 10:43:33.538164 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 609/1242] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:43:34.464276 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5d660d2e-5e16-4932-b001-65675007821c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:43:34.464998 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5d660d2e-5e16-4932-b001-65675007821c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 0c898cc8-5c65-42eb-839e-4022a1dd965a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:43:34.473435 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d660d2e-5e16-4932-b001-65675007821c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:34.474032 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d660d2e-5e16-4932-b001-65675007821c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:34.474566 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d660d2e-5e16-4932-b001-65675007821c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:34.475457 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d660d2e-5e16-4932-b001-65675007821c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:34.476019 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d660d2e-5e16-4932-b001-65675007821c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:34.476542 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d660d2e-5e16-4932-b001-65675007821c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:34.619623 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5d660d2e-5e16-4932-b001-65675007821c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:43:34.627268 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5d660d2e-5e16-4932-b001-65675007821c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a" status: 200 len: 1266 microversion: 2.1 time: 0.168932 Aug 05 10:43:34.627797 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 634/1243] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:43:34 2022] GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:43:35.653017 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-8de0b3a4-7a75-4b3f-9eca-e567ffd86fa9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:43:35.654199 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-8de0b3a4-7a75-4b3f-9eca-e567ffd86fa9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 0c898cc8-5c65-42eb-839e-4022a1dd965a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:43:35.665511 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8de0b3a4-7a75-4b3f-9eca-e567ffd86fa9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:35.665994 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8de0b3a4-7a75-4b3f-9eca-e567ffd86fa9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:35.666444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8de0b3a4-7a75-4b3f-9eca-e567ffd86fa9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:35.667179 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8de0b3a4-7a75-4b3f-9eca-e567ffd86fa9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:35.667634 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8de0b3a4-7a75-4b3f-9eca-e567ffd86fa9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:35.668057 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8de0b3a4-7a75-4b3f-9eca-e567ffd86fa9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:35.819841 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-8de0b3a4-7a75-4b3f-9eca-e567ffd86fa9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:43:35.832056 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-8de0b3a4-7a75-4b3f-9eca-e567ffd86fa9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a" status: 200 len: 1266 microversion: 2.1 time: 0.186015 Aug 05 10:43:35.832792 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 610/1244] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:43:35 2022] GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:43:36.853513 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d027712b-baf0-48a8-b11c-c7ac71f7c89f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:43:36.854178 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d027712b-baf0-48a8-b11c-c7ac71f7c89f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 0c898cc8-5c65-42eb-839e-4022a1dd965a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:43:36.860935 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d027712b-baf0-48a8-b11c-c7ac71f7c89f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:36.861447 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d027712b-baf0-48a8-b11c-c7ac71f7c89f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:36.861880 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d027712b-baf0-48a8-b11c-c7ac71f7c89f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:36.862577 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d027712b-baf0-48a8-b11c-c7ac71f7c89f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:36.863064 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d027712b-baf0-48a8-b11c-c7ac71f7c89f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:36.863484 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d027712b-baf0-48a8-b11c-c7ac71f7c89f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:36.999184 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d027712b-baf0-48a8-b11c-c7ac71f7c89f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:43:37.007336 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d027712b-baf0-48a8-b11c-c7ac71f7c89f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a" status: 200 len: 1266 microversion: 2.1 time: 0.158247 Aug 05 10:43:37.007964 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 635/1245] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:43:36 2022] GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:43:38.031244 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-8c8e20f7-b106-4f25-b4b2-6ce71356f888 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:43:38.032129 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-8c8e20f7-b106-4f25-b4b2-6ce71356f888 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 0c898cc8-5c65-42eb-839e-4022a1dd965a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:43:38.040953 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8c8e20f7-b106-4f25-b4b2-6ce71356f888 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:38.041438 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8c8e20f7-b106-4f25-b4b2-6ce71356f888 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:38.041869 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8c8e20f7-b106-4f25-b4b2-6ce71356f888 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:38.042933 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8c8e20f7-b106-4f25-b4b2-6ce71356f888 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:38.043395 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8c8e20f7-b106-4f25-b4b2-6ce71356f888 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:38.043829 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-8c8e20f7-b106-4f25-b4b2-6ce71356f888 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:38.203113 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-8c8e20f7-b106-4f25-b4b2-6ce71356f888 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:43:38.211698 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-8c8e20f7-b106-4f25-b4b2-6ce71356f888 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a" status: 200 len: 1266 microversion: 2.1 time: 0.185690 Aug 05 10:43:38.212240 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 611/1246] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:43:38 2022] GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:43:39.233442 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1c730be1-932f-469a-9f28-fea65553c3c1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:43:39.234081 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1c730be1-932f-469a-9f28-fea65553c3c1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 0c898cc8-5c65-42eb-839e-4022a1dd965a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:43:39.241245 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c730be1-932f-469a-9f28-fea65553c3c1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:39.241722 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c730be1-932f-469a-9f28-fea65553c3c1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:39.242141 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c730be1-932f-469a-9f28-fea65553c3c1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:39.242856 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c730be1-932f-469a-9f28-fea65553c3c1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:39.243689 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c730be1-932f-469a-9f28-fea65553c3c1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:39.244115 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c730be1-932f-469a-9f28-fea65553c3c1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:39.612809 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1c730be1-932f-469a-9f28-fea65553c3c1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:43:39.622887 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1c730be1-932f-469a-9f28-fea65553c3c1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a" status: 200 len: 1266 microversion: 2.1 time: 0.393481 Aug 05 10:43:39.623512 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 636/1247] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:43:39 2022] GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a => generated 1266 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:43:40.649205 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ba1f9ebe-8035-4b03-9274-d95c41254e8b tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:43:40.649828 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-ba1f9ebe-8035-4b03-9274-d95c41254e8b tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 0c898cc8-5c65-42eb-839e-4022a1dd965a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:43:40.652541 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=2 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:43:40.659452 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ba1f9ebe-8035-4b03-9274-d95c41254e8b tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:40.659983 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ba1f9ebe-8035-4b03-9274-d95c41254e8b tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:40.660464 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ba1f9ebe-8035-4b03-9274-d95c41254e8b tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:40.661227 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ba1f9ebe-8035-4b03-9274-d95c41254e8b tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:40.661726 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ba1f9ebe-8035-4b03-9274-d95c41254e8b tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:40.662191 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-ba1f9ebe-8035-4b03-9274-d95c41254e8b tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:40.797919 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-ba1f9ebe-8035-4b03-9274-d95c41254e8b tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:43:40.805665 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ba1f9ebe-8035-4b03-9274-d95c41254e8b tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a" status: 200 len: 1266 microversion: 2.1 time: 0.163636 Aug 05 10:43:40.806256 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 612/1248] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:43:40 2022] GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:43:41.826129 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-65b38b83-8bf2-4900-876a-4bb3c262d078 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:43:41.826716 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-65b38b83-8bf2-4900-876a-4bb3c262d078 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 0c898cc8-5c65-42eb-839e-4022a1dd965a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:43:41.828767 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:43:41.829443 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:43:41.836084 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-65b38b83-8bf2-4900-876a-4bb3c262d078 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:41.836582 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-65b38b83-8bf2-4900-876a-4bb3c262d078 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:41.837012 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-65b38b83-8bf2-4900-876a-4bb3c262d078 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:41.837701 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-65b38b83-8bf2-4900-876a-4bb3c262d078 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:41.838147 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-65b38b83-8bf2-4900-876a-4bb3c262d078 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:41.838567 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-65b38b83-8bf2-4900-876a-4bb3c262d078 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:41.975661 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-65b38b83-8bf2-4900-876a-4bb3c262d078 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:43:41.987452 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-65b38b83-8bf2-4900-876a-4bb3c262d078 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a" status: 200 len: 1266 microversion: 2.1 time: 0.165121 Aug 05 10:43:41.988273 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 637/1249] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:43:41 2022] GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:43:43.012520 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-b1ec29ca-4219-4922-afc7-76e4bb9d70be tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:43:43.013172 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-b1ec29ca-4219-4922-afc7-76e4bb9d70be tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 0c898cc8-5c65-42eb-839e-4022a1dd965a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:43:43.019814 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b1ec29ca-4219-4922-afc7-76e4bb9d70be tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:43.020226 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b1ec29ca-4219-4922-afc7-76e4bb9d70be tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:43.020658 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b1ec29ca-4219-4922-afc7-76e4bb9d70be tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:43.021375 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b1ec29ca-4219-4922-afc7-76e4bb9d70be tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:43.021826 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b1ec29ca-4219-4922-afc7-76e4bb9d70be tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:43.022242 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-b1ec29ca-4219-4922-afc7-76e4bb9d70be tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:43.421044 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-b1ec29ca-4219-4922-afc7-76e4bb9d70be tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:43:43.432222 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-b1ec29ca-4219-4922-afc7-76e4bb9d70be tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a" status: 200 len: 1266 microversion: 2.1 time: 0.424886 Aug 05 10:43:43.432790 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 613/1250] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:43:43 2022] GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a => generated 1266 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:43:44.451973 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-569e018e-ca2f-45b3-bc75-9ccb3ae414e4 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:43:44.452752 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-569e018e-ca2f-45b3-bc75-9ccb3ae414e4 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 0c898cc8-5c65-42eb-839e-4022a1dd965a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:43:44.459209 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-569e018e-ca2f-45b3-bc75-9ccb3ae414e4 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:44.459969 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-569e018e-ca2f-45b3-bc75-9ccb3ae414e4 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:44.460412 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-569e018e-ca2f-45b3-bc75-9ccb3ae414e4 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:44.461126 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-569e018e-ca2f-45b3-bc75-9ccb3ae414e4 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:44.461581 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-569e018e-ca2f-45b3-bc75-9ccb3ae414e4 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:44.462003 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-569e018e-ca2f-45b3-bc75-9ccb3ae414e4 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:44.506014 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-8ce7c3ee-61aa-4554-8779-bcb1c4bb758f req-949a6aae-7eca-4d1f-b2fa-211a0b9c8daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c898cc8-5c65-42eb-839e-4022a1dd965a", "name": "network-vif-plugged", "status": "completed", "tag": "eabd1b40-e101-4364-a3a5-8d15430db18b"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:43:44.517519 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8ce7c3ee-61aa-4554-8779-bcb1c4bb758f req-949a6aae-7eca-4d1f-b2fa-211a0b9c8daa service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:44.517966 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8ce7c3ee-61aa-4554-8779-bcb1c4bb758f req-949a6aae-7eca-4d1f-b2fa-211a0b9c8daa service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:44.518397 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8ce7c3ee-61aa-4554-8779-bcb1c4bb758f req-949a6aae-7eca-4d1f-b2fa-211a0b9c8daa service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:44.530399 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-8ce7c3ee-61aa-4554-8779-bcb1c4bb758f req-949a6aae-7eca-4d1f-b2fa-211a0b9c8daa service nova] Creating event network-vif-plugged:eabd1b40-e101-4364-a3a5-8d15430db18b for instance 0c898cc8-5c65-42eb-839e-4022a1dd965a on hv-cinder-81558 Aug 05 10:43:44.535525 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-8ce7c3ee-61aa-4554-8779-bcb1c4bb758f req-949a6aae-7eca-4d1f-b2fa-211a0b9c8daa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097383 Aug 05 10:43:44.536127 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 638/1251] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:43:44.600447 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-569e018e-ca2f-45b3-bc75-9ccb3ae414e4 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:43:44.608385 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-569e018e-ca2f-45b3-bc75-9ccb3ae414e4 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a" status: 200 len: 1266 microversion: 2.1 time: 0.160161 Aug 05 10:43:44.608957 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 614/1252] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:43:44 2022] GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:43:45.632545 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-143ece09-8734-4481-b21c-374f45953e6d tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:43:45.633468 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-143ece09-8734-4481-b21c-374f45953e6d tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 0c898cc8-5c65-42eb-839e-4022a1dd965a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:43:45.642418 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-143ece09-8734-4481-b21c-374f45953e6d tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:45.643156 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-143ece09-8734-4481-b21c-374f45953e6d tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:45.643765 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-143ece09-8734-4481-b21c-374f45953e6d tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:45.644703 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-143ece09-8734-4481-b21c-374f45953e6d tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:45.645147 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-143ece09-8734-4481-b21c-374f45953e6d tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:45.645782 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-143ece09-8734-4481-b21c-374f45953e6d tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:45.794931 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-143ece09-8734-4481-b21c-374f45953e6d tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:43:45.805781 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-143ece09-8734-4481-b21c-374f45953e6d tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a" status: 200 len: 1266 microversion: 2.1 time: 0.179380 Aug 05 10:43:45.806380 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 639/1253] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:43:45 2022] GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:43:46.833687 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-91225ebd-4db8-4f1b-aa5b-17bcba9b1d09 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:43:46.834345 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-91225ebd-4db8-4f1b-aa5b-17bcba9b1d09 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 0c898cc8-5c65-42eb-839e-4022a1dd965a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:43:46.841446 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-91225ebd-4db8-4f1b-aa5b-17bcba9b1d09 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:46.841989 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-91225ebd-4db8-4f1b-aa5b-17bcba9b1d09 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:46.842372 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-91225ebd-4db8-4f1b-aa5b-17bcba9b1d09 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:46.843223 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-91225ebd-4db8-4f1b-aa5b-17bcba9b1d09 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:46.843681 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-91225ebd-4db8-4f1b-aa5b-17bcba9b1d09 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:46.844084 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-91225ebd-4db8-4f1b-aa5b-17bcba9b1d09 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:46.979156 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-91225ebd-4db8-4f1b-aa5b-17bcba9b1d09 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:43:46.990213 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-91225ebd-4db8-4f1b-aa5b-17bcba9b1d09 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a" status: 200 len: 1454 microversion: 2.1 time: 0.160040 Aug 05 10:43:46.991098 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 615/1254] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:43:46 2022] GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a => generated 1454 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:43:47.011354 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0ff53d13-3154-4e08-9c8b-9d96b52ea3e7 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:43:47.012114 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0ff53d13-3154-4e08-9c8b-9d96b52ea3e7 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 0c898cc8-5c65-42eb-839e-4022a1dd965a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:43:47.018580 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0ff53d13-3154-4e08-9c8b-9d96b52ea3e7 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:47.019097 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0ff53d13-3154-4e08-9c8b-9d96b52ea3e7 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:47.019529 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0ff53d13-3154-4e08-9c8b-9d96b52ea3e7 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:47.020214 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0ff53d13-3154-4e08-9c8b-9d96b52ea3e7 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:47.020654 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0ff53d13-3154-4e08-9c8b-9d96b52ea3e7 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:47.021068 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0ff53d13-3154-4e08-9c8b-9d96b52ea3e7 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:47.158689 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0ff53d13-3154-4e08-9c8b-9d96b52ea3e7 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:43:47.168644 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0ff53d13-3154-4e08-9c8b-9d96b52ea3e7 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a" status: 200 len: 1454 microversion: 2.1 time: 0.160949 Aug 05 10:43:47.169620 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 640/1255] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:43:47 2022] GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:43:48.812241 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [req-f97a2fd4-c16d-46a4-8db5-d9c10c7405f6 req-cbcaf950-cf58-4097-82af-c11552987f45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c898cc8-5c65-42eb-839e-4022a1dd965a", "tag": "eabd1b40-e101-4364-a3a5-8d15430db18b"}]} {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:43:48.822464 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-f97a2fd4-c16d-46a4-8db5-d9c10c7405f6 req-cbcaf950-cf58-4097-82af-c11552987f45 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:43:48.822970 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-f97a2fd4-c16d-46a4-8db5-d9c10c7405f6 req-cbcaf950-cf58-4097-82af-c11552987f45 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:43:48.823403 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [req-f97a2fd4-c16d-46a4-8db5-d9c10c7405f6 req-cbcaf950-cf58-4097-82af-c11552987f45 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:43:48.834605 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.compute.server_external_events [req-f97a2fd4-c16d-46a4-8db5-d9c10c7405f6 req-cbcaf950-cf58-4097-82af-c11552987f45 service nova] Creating event network-changed:eabd1b40-e101-4364-a3a5-8d15430db18b for instance 0c898cc8-5c65-42eb-839e-4022a1dd965a on hv-cinder-81558 Aug 05 10:43:48.840288 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [req-f97a2fd4-c16d-46a4-8db5-d9c10c7405f6 req-cbcaf950-cf58-4097-82af-c11552987f45 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031772 Aug 05 10:43:48.840875 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 616/1256] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:44:50.128849 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 10:44:50.129990 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Fri Aug 5 10:44:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 10:45:51.041113 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:45:51.041862 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=72 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:45:51.046236 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3101cd4b-a369-4224-bdf6-1292193dad1c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-978083798", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1855561432", "security_groups": [{"name": "tempest-secgroup-smoke-116129686"}], "block_device_mapping_v2": [{"uuid": "0d7c357d-766e-4387-97be-c6f6a038ed28", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "96bc74ca-f39c-4f14-b9e3-8c46e8c7690b"}]}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:45:51.175771 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-3101cd4b-a369-4224-bdf6-1292193dad1c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] validate_networks() for [('96bc74ca-f39c-4f14-b9e3-8c46e8c7690b', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 10:45:51.578031 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3101cd4b-a369-4224-bdf6-1292193dad1c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 10:45:51.578450 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3101cd4b-a369-4224-bdf6-1292193dad1c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 10:45:51.578952 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3101cd4b-a369-4224-bdf6-1292193dad1c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 10:45:51.579402 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3101cd4b-a369-4224-bdf6-1292193dad1c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 10:45:51.579812 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3101cd4b-a369-4224-bdf6-1292193dad1c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 10:45:51.589968 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3101cd4b-a369-4224-bdf6-1292193dad1c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:45:51.590442 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3101cd4b-a369-4224-bdf6-1292193dad1c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:45:51.590871 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3101cd4b-a369-4224-bdf6-1292193dad1c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:45:51.591628 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3101cd4b-a369-4224-bdf6-1292193dad1c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:45:51.592075 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3101cd4b-a369-4224-bdf6-1292193dad1c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:45:51.592498 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3101cd4b-a369-4224-bdf6-1292193dad1c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:45:51.611979 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-3101cd4b-a369-4224-bdf6-1292193dad1c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Getting quotas for project 28cf7e20408a43c3bff9f70ad661d638. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 10:45:51.617529 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-3101cd4b-a369-4224-bdf6-1292193dad1c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Getting quotas for user c93e81531ea54583b11f5a6c107c9166 and project 28cf7e20408a43c3bff9f70ad661d638. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 10:45:51.676936 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3101cd4b-a369-4224-bdf6-1292193dad1c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 10:45:51.679313 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3101cd4b-a369-4224-bdf6-1292193dad1c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 635c0eba-edc3-43fc-a068-5ad97b821594] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0d7c357d-766e-4387-97be-c6f6a038ed28',volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 10:45:51.819704 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3101cd4b-a369-4224-bdf6-1292193dad1c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.780526 Aug 05 10:45:51.820345 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 641/1257] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 5 10:45:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 10:45:51.829590 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d40a44c7-9947-4c07-88a0-6767aee0533c] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 05 10:45:51.830184 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:45:51.831092 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:45:51.835684 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-e9928a55-3f99-45e6-9dcd-31f7fef280ba tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:45:51.836384 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-e9928a55-3f99-45e6-9dcd-31f7fef280ba tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 635c0eba-edc3-43fc-a068-5ad97b821594] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:45:51.896928 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e9928a55-3f99-45e6-9dcd-31f7fef280ba tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:45:51.903654 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-e9928a55-3f99-45e6-9dcd-31f7fef280ba tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594" status: 200 len: 1094 microversion: 2.1 time: 0.075855 Aug 05 10:45:51.904521 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 617/1258] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:45:51 2022] GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:45:52.924486 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a5e96e67-7e67-434d-aab9-04f15ec020a9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:45:52.925113 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a5e96e67-7e67-434d-aab9-04f15ec020a9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 635c0eba-edc3-43fc-a068-5ad97b821594] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:45:52.932088 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a5e96e67-7e67-434d-aab9-04f15ec020a9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:45:52.932609 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a5e96e67-7e67-434d-aab9-04f15ec020a9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:45:52.933040 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a5e96e67-7e67-434d-aab9-04f15ec020a9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:45:52.933903 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a5e96e67-7e67-434d-aab9-04f15ec020a9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:45:52.934384 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a5e96e67-7e67-434d-aab9-04f15ec020a9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:45:52.934785 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a5e96e67-7e67-434d-aab9-04f15ec020a9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:45:53.002945 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a5e96e67-7e67-434d-aab9-04f15ec020a9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:45:53.011407 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a5e96e67-7e67-434d-aab9-04f15ec020a9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594" status: 200 len: 1210 microversion: 2.1 time: 0.091146 Aug 05 10:45:53.012528 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 642/1259] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:45:52 2022] GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594 => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:45:54.033681 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-6ac94d77-a704-45f5-a3b4-fc05a9c3e602 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:45:54.034323 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-6ac94d77-a704-45f5-a3b4-fc05a9c3e602 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 635c0eba-edc3-43fc-a068-5ad97b821594] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:45:54.043521 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6ac94d77-a704-45f5-a3b4-fc05a9c3e602 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:45:54.044011 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6ac94d77-a704-45f5-a3b4-fc05a9c3e602 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:45:54.044415 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6ac94d77-a704-45f5-a3b4-fc05a9c3e602 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:45:54.045121 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6ac94d77-a704-45f5-a3b4-fc05a9c3e602 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:45:54.045569 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6ac94d77-a704-45f5-a3b4-fc05a9c3e602 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:45:54.045990 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-6ac94d77-a704-45f5-a3b4-fc05a9c3e602 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:45:54.054847 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO oslo.messaging._drivers.impl_rabbit [-] [d40a44c7-9947-4c07-88a0-6767aee0533c] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 49806. Aug 05 10:45:54.256356 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-6ac94d77-a704-45f5-a3b4-fc05a9c3e602 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:45:54.264309 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-6ac94d77-a704-45f5-a3b4-fc05a9c3e602 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594" status: 200 len: 1265 microversion: 2.1 time: 0.234499 Aug 05 10:45:54.264851 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 618/1260] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:45:54 2022] GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:45:54.346436 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-24f4acd9-f174-4bb8-86d7-e6816b159cf1 req-18d471c9-143f-41eb-b28a-4facea71acdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635c0eba-edc3-43fc-a068-5ad97b821594", "tag": "6ebf89db-0776-42bb-902f-e43385d5e437"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:45:54.357578 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-24f4acd9-f174-4bb8-86d7-e6816b159cf1 req-18d471c9-143f-41eb-b28a-4facea71acdf service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:45:54.358326 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-24f4acd9-f174-4bb8-86d7-e6816b159cf1 req-18d471c9-143f-41eb-b28a-4facea71acdf service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:45:54.358936 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-24f4acd9-f174-4bb8-86d7-e6816b159cf1 req-18d471c9-143f-41eb-b28a-4facea71acdf service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:45:54.371606 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-24f4acd9-f174-4bb8-86d7-e6816b159cf1 req-18d471c9-143f-41eb-b28a-4facea71acdf service nova] Creating event network-changed:6ebf89db-0776-42bb-902f-e43385d5e437 for instance 635c0eba-edc3-43fc-a068-5ad97b821594 on hv-cinder-81558 Aug 05 10:45:54.374966 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR oslo.messaging._drivers.impl_rabbit [req-24f4acd9-f174-4bb8-86d7-e6816b159cf1 req-18d471c9-143f-41eb-b28a-4facea71acdf service nova] [9dd783e2-c031-4245-9263-cdfcd25bf2e7] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 05 10:45:55.289928 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c23f65b7-77f3-494e-baf4-a8079ec59964 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:45:55.290820 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c23f65b7-77f3-494e-baf4-a8079ec59964 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 635c0eba-edc3-43fc-a068-5ad97b821594] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:45:55.300811 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c23f65b7-77f3-494e-baf4-a8079ec59964 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:45:55.301540 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c23f65b7-77f3-494e-baf4-a8079ec59964 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:45:55.302310 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c23f65b7-77f3-494e-baf4-a8079ec59964 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:45:55.303057 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c23f65b7-77f3-494e-baf4-a8079ec59964 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:45:55.303491 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c23f65b7-77f3-494e-baf4-a8079ec59964 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:45:55.303959 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c23f65b7-77f3-494e-baf4-a8079ec59964 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:45:55.385483 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [req-24f4acd9-f174-4bb8-86d7-e6816b159cf1 req-18d471c9-143f-41eb-b28a-4facea71acdf service nova] [9dd783e2-c031-4245-9263-cdfcd25bf2e7] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 49812. Aug 05 10:45:55.389439 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-24f4acd9-f174-4bb8-86d7-e6816b159cf1 req-18d471c9-143f-41eb-b28a-4facea71acdf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.046953 Aug 05 10:45:55.390208 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 643/1261] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:45:55.446158 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-c23f65b7-77f3-494e-baf4-a8079ec59964 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:45:55.454187 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c23f65b7-77f3-494e-baf4-a8079ec59964 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594" status: 200 len: 1265 microversion: 2.1 time: 0.171840 Aug 05 10:45:55.454742 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 619/1262] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:45:55 2022] GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:45:56.477133 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2dc5131c-dfd2-4db3-aaba-22556c331e5a tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:45:56.477858 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2dc5131c-dfd2-4db3-aaba-22556c331e5a tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 635c0eba-edc3-43fc-a068-5ad97b821594] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:45:56.484383 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2dc5131c-dfd2-4db3-aaba-22556c331e5a tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:45:56.484851 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2dc5131c-dfd2-4db3-aaba-22556c331e5a tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:45:56.485290 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2dc5131c-dfd2-4db3-aaba-22556c331e5a tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:45:56.486284 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2dc5131c-dfd2-4db3-aaba-22556c331e5a tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:45:56.486756 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2dc5131c-dfd2-4db3-aaba-22556c331e5a tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:45:56.487206 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2dc5131c-dfd2-4db3-aaba-22556c331e5a tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:45:56.632568 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2dc5131c-dfd2-4db3-aaba-22556c331e5a tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:45:56.640171 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2dc5131c-dfd2-4db3-aaba-22556c331e5a tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594" status: 200 len: 1265 microversion: 2.1 time: 0.167828 Aug 05 10:45:56.640735 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 644/1263] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:45:56 2022] GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:45:57.661382 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-82211dbc-a515-4d7e-ad30-02d13118f482 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:45:57.662674 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-82211dbc-a515-4d7e-ad30-02d13118f482 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 635c0eba-edc3-43fc-a068-5ad97b821594] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:45:57.670102 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-82211dbc-a515-4d7e-ad30-02d13118f482 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:45:57.670671 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-82211dbc-a515-4d7e-ad30-02d13118f482 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:45:57.671237 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-82211dbc-a515-4d7e-ad30-02d13118f482 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:45:57.672047 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-82211dbc-a515-4d7e-ad30-02d13118f482 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:45:57.672580 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-82211dbc-a515-4d7e-ad30-02d13118f482 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:45:57.673081 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-82211dbc-a515-4d7e-ad30-02d13118f482 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:45:57.812703 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-82211dbc-a515-4d7e-ad30-02d13118f482 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:45:57.820442 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-82211dbc-a515-4d7e-ad30-02d13118f482 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594" status: 200 len: 1265 microversion: 2.1 time: 0.163692 Aug 05 10:45:57.821051 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 620/1264] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:45:57 2022] GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:45:58.845586 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-187d9a30-f064-415b-920a-cae624e901c4 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:45:58.846571 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-187d9a30-f064-415b-920a-cae624e901c4 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 635c0eba-edc3-43fc-a068-5ad97b821594] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:45:58.854559 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-187d9a30-f064-415b-920a-cae624e901c4 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:45:58.855099 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-187d9a30-f064-415b-920a-cae624e901c4 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:45:58.855531 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-187d9a30-f064-415b-920a-cae624e901c4 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:45:58.856223 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-187d9a30-f064-415b-920a-cae624e901c4 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:45:58.856675 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-187d9a30-f064-415b-920a-cae624e901c4 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:45:58.857074 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-187d9a30-f064-415b-920a-cae624e901c4 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:45:59.005098 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-187d9a30-f064-415b-920a-cae624e901c4 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:45:59.016661 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-187d9a30-f064-415b-920a-cae624e901c4 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594" status: 200 len: 1265 microversion: 2.1 time: 0.177653 Aug 05 10:45:59.017401 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 645/1265] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:45:58 2022] GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:46:00.043542 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-903fc13f-a7ef-436e-97af-47105cbf0b52 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:46:00.044479 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-903fc13f-a7ef-436e-97af-47105cbf0b52 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 635c0eba-edc3-43fc-a068-5ad97b821594] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:46:00.054534 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-903fc13f-a7ef-436e-97af-47105cbf0b52 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:46:00.055045 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-903fc13f-a7ef-436e-97af-47105cbf0b52 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:46:00.055477 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-903fc13f-a7ef-436e-97af-47105cbf0b52 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:46:00.056171 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-903fc13f-a7ef-436e-97af-47105cbf0b52 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:46:00.056619 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-903fc13f-a7ef-436e-97af-47105cbf0b52 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:46:00.057039 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-903fc13f-a7ef-436e-97af-47105cbf0b52 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:46:00.195793 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-903fc13f-a7ef-436e-97af-47105cbf0b52 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:46:00.203614 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-903fc13f-a7ef-436e-97af-47105cbf0b52 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594" status: 200 len: 1265 microversion: 2.1 time: 0.167038 Aug 05 10:46:00.204150 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 621/1266] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:46:00 2022] GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:46:01.236292 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6bf85251-b3aa-412c-8d59-ab8f1ae6b08f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:46:01.237280 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6bf85251-b3aa-412c-8d59-ab8f1ae6b08f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 635c0eba-edc3-43fc-a068-5ad97b821594] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:46:01.245861 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bf85251-b3aa-412c-8d59-ab8f1ae6b08f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:46:01.246343 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bf85251-b3aa-412c-8d59-ab8f1ae6b08f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:46:01.246780 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bf85251-b3aa-412c-8d59-ab8f1ae6b08f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:46:01.247521 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bf85251-b3aa-412c-8d59-ab8f1ae6b08f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:46:01.247973 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bf85251-b3aa-412c-8d59-ab8f1ae6b08f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:46:01.248410 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bf85251-b3aa-412c-8d59-ab8f1ae6b08f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:46:01.390106 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6bf85251-b3aa-412c-8d59-ab8f1ae6b08f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:46:01.400877 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6bf85251-b3aa-412c-8d59-ab8f1ae6b08f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594" status: 200 len: 1265 microversion: 2.1 time: 0.171562 Aug 05 10:46:01.401444 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 646/1267] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:46:01 2022] GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:46:02.425372 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-3b342a60-4f52-497d-b85f-c6617501596f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:46:02.426369 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-3b342a60-4f52-497d-b85f-c6617501596f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 635c0eba-edc3-43fc-a068-5ad97b821594] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:46:02.430136 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell0:SELECT=2 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:46:02.439583 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3b342a60-4f52-497d-b85f-c6617501596f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:46:02.440373 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3b342a60-4f52-497d-b85f-c6617501596f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:46:02.441084 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3b342a60-4f52-497d-b85f-c6617501596f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:46:02.442214 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3b342a60-4f52-497d-b85f-c6617501596f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:46:02.442987 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3b342a60-4f52-497d-b85f-c6617501596f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:46:02.443697 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-3b342a60-4f52-497d-b85f-c6617501596f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:46:02.591007 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-3b342a60-4f52-497d-b85f-c6617501596f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:46:02.599143 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-3b342a60-4f52-497d-b85f-c6617501596f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594" status: 200 len: 1265 microversion: 2.1 time: 0.180238 Aug 05 10:46:02.599711 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 622/1268] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:46:02 2022] GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:46:03.622406 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-15c1ce31-3508-4721-ab5b-eb565ffa782a tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:46:03.623262 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-15c1ce31-3508-4721-ab5b-eb565ffa782a tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 635c0eba-edc3-43fc-a068-5ad97b821594] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:46:03.625960 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:46:03.627225 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:46:03.636563 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-15c1ce31-3508-4721-ab5b-eb565ffa782a tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:46:03.636710 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-15c1ce31-3508-4721-ab5b-eb565ffa782a tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:46:03.637253 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-15c1ce31-3508-4721-ab5b-eb565ffa782a tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:46:03.638185 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-15c1ce31-3508-4721-ab5b-eb565ffa782a tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:46:03.638786 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-15c1ce31-3508-4721-ab5b-eb565ffa782a tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:46:03.639385 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-15c1ce31-3508-4721-ab5b-eb565ffa782a tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:46:03.779608 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-15c1ce31-3508-4721-ab5b-eb565ffa782a tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:46:03.787245 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-15c1ce31-3508-4721-ab5b-eb565ffa782a tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594" status: 200 len: 1265 microversion: 2.1 time: 0.169936 Aug 05 10:46:03.787816 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 647/1269] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:46:03 2022] GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:46:04.811697 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-0847319e-0d72-4aca-8af1-9bcccc2531b9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:46:04.812691 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-0847319e-0d72-4aca-8af1-9bcccc2531b9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 635c0eba-edc3-43fc-a068-5ad97b821594] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:46:04.822927 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0847319e-0d72-4aca-8af1-9bcccc2531b9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:46:04.823436 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0847319e-0d72-4aca-8af1-9bcccc2531b9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:46:04.823861 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0847319e-0d72-4aca-8af1-9bcccc2531b9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:46:04.824544 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0847319e-0d72-4aca-8af1-9bcccc2531b9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:46:04.824988 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0847319e-0d72-4aca-8af1-9bcccc2531b9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:46:04.825401 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0847319e-0d72-4aca-8af1-9bcccc2531b9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:46:04.960575 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-0847319e-0d72-4aca-8af1-9bcccc2531b9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:46:04.969236 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-0847319e-0d72-4aca-8af1-9bcccc2531b9 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594" status: 200 len: 1265 microversion: 2.1 time: 0.164144 Aug 05 10:46:04.969794 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 623/1270] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:46:04 2022] GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:46:05.167802 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-bb06cf50-b022-4e03-a66e-fa61045a2bac req-ba76b28c-a75b-4152-a6a9-3761b8798414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635c0eba-edc3-43fc-a068-5ad97b821594", "name": "network-vif-plugged", "status": "completed", "tag": "6ebf89db-0776-42bb-902f-e43385d5e437"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:46:05.179061 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-bb06cf50-b022-4e03-a66e-fa61045a2bac req-ba76b28c-a75b-4152-a6a9-3761b8798414 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:46:05.179569 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-bb06cf50-b022-4e03-a66e-fa61045a2bac req-ba76b28c-a75b-4152-a6a9-3761b8798414 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:46:05.179998 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-bb06cf50-b022-4e03-a66e-fa61045a2bac req-ba76b28c-a75b-4152-a6a9-3761b8798414 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:46:05.193681 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-bb06cf50-b022-4e03-a66e-fa61045a2bac req-ba76b28c-a75b-4152-a6a9-3761b8798414 service nova] Creating event network-vif-plugged:6ebf89db-0776-42bb-902f-e43385d5e437 for instance 635c0eba-edc3-43fc-a068-5ad97b821594 on hv-cinder-81558 Aug 05 10:46:05.198906 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-bb06cf50-b022-4e03-a66e-fa61045a2bac req-ba76b28c-a75b-4152-a6a9-3761b8798414 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034941 Aug 05 10:46:05.199532 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 648/1271] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:46:05.993651 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-fe83b546-c5ed-4db6-827d-5b1bff54c619 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:46:05.994483 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-fe83b546-c5ed-4db6-827d-5b1bff54c619 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 635c0eba-edc3-43fc-a068-5ad97b821594] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:46:06.004780 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fe83b546-c5ed-4db6-827d-5b1bff54c619 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:46:06.005525 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fe83b546-c5ed-4db6-827d-5b1bff54c619 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:46:06.006126 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fe83b546-c5ed-4db6-827d-5b1bff54c619 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:46:06.007243 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fe83b546-c5ed-4db6-827d-5b1bff54c619 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:46:06.007858 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fe83b546-c5ed-4db6-827d-5b1bff54c619 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:46:06.008506 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-fe83b546-c5ed-4db6-827d-5b1bff54c619 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:46:06.150219 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-fe83b546-c5ed-4db6-827d-5b1bff54c619 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:46:06.158584 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-fe83b546-c5ed-4db6-827d-5b1bff54c619 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594" status: 200 len: 1265 microversion: 2.1 time: 0.171038 Aug 05 10:46:06.159200 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 624/1272] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:46:05 2022] GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:46:07.183990 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0a4e4179-de2b-4cd9-b5f1-6268b3146abc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:46:07.184673 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0a4e4179-de2b-4cd9-b5f1-6268b3146abc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 635c0eba-edc3-43fc-a068-5ad97b821594] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:46:07.191451 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a4e4179-de2b-4cd9-b5f1-6268b3146abc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:46:07.191927 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a4e4179-de2b-4cd9-b5f1-6268b3146abc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:46:07.192352 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a4e4179-de2b-4cd9-b5f1-6268b3146abc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:46:07.193033 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a4e4179-de2b-4cd9-b5f1-6268b3146abc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:46:07.193486 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a4e4179-de2b-4cd9-b5f1-6268b3146abc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:46:07.193901 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a4e4179-de2b-4cd9-b5f1-6268b3146abc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:46:07.334103 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0a4e4179-de2b-4cd9-b5f1-6268b3146abc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:46:07.341958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0a4e4179-de2b-4cd9-b5f1-6268b3146abc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594" status: 200 len: 1453 microversion: 2.1 time: 0.164815 Aug 05 10:46:07.342578 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 649/1273] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:46:07 2022] GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:46:07.362555 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-32933e02-8a14-4235-9c82-55686d1ee00f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:46:07.363242 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-32933e02-8a14-4235-9c82-55686d1ee00f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 635c0eba-edc3-43fc-a068-5ad97b821594] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:46:07.370456 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-32933e02-8a14-4235-9c82-55686d1ee00f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:46:07.370967 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-32933e02-8a14-4235-9c82-55686d1ee00f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:46:07.371405 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-32933e02-8a14-4235-9c82-55686d1ee00f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:46:07.372102 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-32933e02-8a14-4235-9c82-55686d1ee00f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:46:07.372558 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-32933e02-8a14-4235-9c82-55686d1ee00f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:46:07.372983 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-32933e02-8a14-4235-9c82-55686d1ee00f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:46:07.518525 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-32933e02-8a14-4235-9c82-55686d1ee00f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:46:07.530470 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-32933e02-8a14-4235-9c82-55686d1ee00f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594" status: 200 len: 1453 microversion: 2.1 time: 0.171880 Aug 05 10:46:07.531244 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 625/1274] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:46:07 2022] GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594 => generated 1453 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:46:09.172558 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-fd5bb26c-b20e-424d-b3bc-5587987b9f21 req-926ae115-845b-4434-9bcb-a2db8eb3eb10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635c0eba-edc3-43fc-a068-5ad97b821594", "tag": "6ebf89db-0776-42bb-902f-e43385d5e437"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:46:09.182666 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-fd5bb26c-b20e-424d-b3bc-5587987b9f21 req-926ae115-845b-4434-9bcb-a2db8eb3eb10 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:46:09.183184 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-fd5bb26c-b20e-424d-b3bc-5587987b9f21 req-926ae115-845b-4434-9bcb-a2db8eb3eb10 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:46:09.183632 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-fd5bb26c-b20e-424d-b3bc-5587987b9f21 req-926ae115-845b-4434-9bcb-a2db8eb3eb10 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:46:09.194945 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-fd5bb26c-b20e-424d-b3bc-5587987b9f21 req-926ae115-845b-4434-9bcb-a2db8eb3eb10 service nova] Creating event network-changed:6ebf89db-0776-42bb-902f-e43385d5e437 for instance 635c0eba-edc3-43fc-a068-5ad97b821594 on hv-cinder-81558 Aug 05 10:46:09.200235 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-fd5bb26c-b20e-424d-b3bc-5587987b9f21 req-926ae115-845b-4434-9bcb-a2db8eb3eb10 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032789 Aug 05 10:46:09.200799 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 650/1275] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:46:14.015755 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 10:46:14.017011 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Fri Aug 5 10:46:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 10:46:23.530319 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 10:46:23.530954 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Fri Aug 5 10:46:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 10:46:45.045705 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 10:46:45.046859 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Fri Aug 5 10:46:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 10:47:59.059088 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_api:SELECT=20 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:47:59.059958 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG dbcounter [-] [117831] Writing DB stats nova_cell1:SELECT=48 {{(pid=117831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:47:59.062338 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:47:59.063371 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=44 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 10:47:59.064532 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-18d70cbf-5741-4425-979a-a23c35a770bc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:47:59.065078 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-18d70cbf-5741-4425-979a-a23c35a770bc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 635c0eba-edc3-43fc-a068-5ad97b821594] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:47:59.072336 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-18d70cbf-5741-4425-979a-a23c35a770bc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:47:59.072809 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-18d70cbf-5741-4425-979a-a23c35a770bc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:47:59.073241 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-18d70cbf-5741-4425-979a-a23c35a770bc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:47:59.074006 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-18d70cbf-5741-4425-979a-a23c35a770bc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:47:59.074389 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-18d70cbf-5741-4425-979a-a23c35a770bc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:47:59.074847 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-18d70cbf-5741-4425-979a-a23c35a770bc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:47:59.101334 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-18d70cbf-5741-4425-979a-a23c35a770bc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 635c0eba-edc3-43fc-a068-5ad97b821594] Going to try to terminate instance {{(pid=117831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 10:47:59.177141 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-3aab1c48-a56a-4e5a-896c-b66f862b30ca req-3fe59855-32c8-4935-9863-5f4bc2ff2dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635c0eba-edc3-43fc-a068-5ad97b821594", "tag": "6ebf89db-0776-42bb-902f-e43385d5e437"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:47:59.188594 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-3aab1c48-a56a-4e5a-896c-b66f862b30ca req-3fe59855-32c8-4935-9863-5f4bc2ff2dd2 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:47:59.189069 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-3aab1c48-a56a-4e5a-896c-b66f862b30ca req-3fe59855-32c8-4935-9863-5f4bc2ff2dd2 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:47:59.189537 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-3aab1c48-a56a-4e5a-896c-b66f862b30ca req-3fe59855-32c8-4935-9863-5f4bc2ff2dd2 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:47:59.203602 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-3aab1c48-a56a-4e5a-896c-b66f862b30ca req-3fe59855-32c8-4935-9863-5f4bc2ff2dd2 service nova] Creating event network-changed:6ebf89db-0776-42bb-902f-e43385d5e437 for instance 635c0eba-edc3-43fc-a068-5ad97b821594 on hv-cinder-81558 Aug 05 10:47:59.208903 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-18d70cbf-5741-4425-979a-a23c35a770bc tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "DELETE /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594" status: 204 len: 0 microversion: 2.1 time: 0.151524 Aug 05 10:47:59.209322 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-3aab1c48-a56a-4e5a-896c-b66f862b30ca req-3fe59855-32c8-4935-9863-5f4bc2ff2dd2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150139 Aug 05 10:47:59.209807 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 626/1276] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:47:59 2022] DELETE /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:47:59.213558 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 651/1277] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:47:59.218477 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-2f0c7acc-b49c-4054-a916-f9e4fd6aef4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:47:59.219227 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-2f0c7acc-b49c-4054-a916-f9e4fd6aef4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 635c0eba-edc3-43fc-a068-5ad97b821594] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:47:59.225480 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2f0c7acc-b49c-4054-a916-f9e4fd6aef4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:47:59.225975 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2f0c7acc-b49c-4054-a916-f9e4fd6aef4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:47:59.226412 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2f0c7acc-b49c-4054-a916-f9e4fd6aef4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:47:59.227153 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2f0c7acc-b49c-4054-a916-f9e4fd6aef4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:47:59.227613 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2f0c7acc-b49c-4054-a916-f9e4fd6aef4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:47:59.228039 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-2f0c7acc-b49c-4054-a916-f9e4fd6aef4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:47:59.367622 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-2f0c7acc-b49c-4054-a916-f9e4fd6aef4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:47:59.375591 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-2f0c7acc-b49c-4054-a916-f9e4fd6aef4f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594" status: 200 len: 1578 microversion: 2.1 time: 0.161362 Aug 05 10:47:59.376248 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 627/1278] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:47:59 2022] GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 10:48:00.398685 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0decb772-56ad-4a3a-8880-b5a4b567ffaa tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:48:00.399360 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0decb772-56ad-4a3a-8880-b5a4b567ffaa tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 635c0eba-edc3-43fc-a068-5ad97b821594] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:48:00.406078 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0decb772-56ad-4a3a-8880-b5a4b567ffaa tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:00.406559 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0decb772-56ad-4a3a-8880-b5a4b567ffaa tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:00.407024 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0decb772-56ad-4a3a-8880-b5a4b567ffaa tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:00.407730 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0decb772-56ad-4a3a-8880-b5a4b567ffaa tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:00.408177 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0decb772-56ad-4a3a-8880-b5a4b567ffaa tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:00.408576 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0decb772-56ad-4a3a-8880-b5a4b567ffaa tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:00.544019 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0decb772-56ad-4a3a-8880-b5a4b567ffaa tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:48:00.551737 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0decb772-56ad-4a3a-8880-b5a4b567ffaa tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594" status: 200 len: 1578 microversion: 2.1 time: 0.157993 Aug 05 10:48:00.552284 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 652/1279] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:48:00 2022] GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:48:01.573666 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-0d556b85-d7c4-4ed6-8b7d-4f3af199d55c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:48:01.574329 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-0d556b85-d7c4-4ed6-8b7d-4f3af199d55c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 635c0eba-edc3-43fc-a068-5ad97b821594] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:48:01.581211 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0d556b85-d7c4-4ed6-8b7d-4f3af199d55c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:01.581959 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0d556b85-d7c4-4ed6-8b7d-4f3af199d55c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:01.582444 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0d556b85-d7c4-4ed6-8b7d-4f3af199d55c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:01.583882 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0d556b85-d7c4-4ed6-8b7d-4f3af199d55c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:01.584343 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0d556b85-d7c4-4ed6-8b7d-4f3af199d55c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:01.584772 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-0d556b85-d7c4-4ed6-8b7d-4f3af199d55c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:01.684972 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-0d556b85-d7c4-4ed6-8b7d-4f3af199d55c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:48:01.698887 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-0d556b85-d7c4-4ed6-8b7d-4f3af199d55c tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594" status: 200 len: 1392 microversion: 2.1 time: 0.129137 Aug 05 10:48:01.699760 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 628/1280] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:48:01 2022] GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594 => generated 1392 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:48:02.007368 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-e18ee10a-10ae-4d22-afd1-9a7e4bac6934 req-ab0a6361-c045-4054-aaee-91adb326d111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635c0eba-edc3-43fc-a068-5ad97b821594", "name": "network-vif-deleted", "tag": "6ebf89db-0776-42bb-902f-e43385d5e437"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:48:02.019690 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-e18ee10a-10ae-4d22-afd1-9a7e4bac6934 req-ab0a6361-c045-4054-aaee-91adb326d111 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:02.020277 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-e18ee10a-10ae-4d22-afd1-9a7e4bac6934 req-ab0a6361-c045-4054-aaee-91adb326d111 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:02.020700 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-e18ee10a-10ae-4d22-afd1-9a7e4bac6934 req-ab0a6361-c045-4054-aaee-91adb326d111 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:02.032732 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-e18ee10a-10ae-4d22-afd1-9a7e4bac6934 req-ab0a6361-c045-4054-aaee-91adb326d111 service nova] Creating event network-vif-deleted:6ebf89db-0776-42bb-902f-e43385d5e437 for instance 635c0eba-edc3-43fc-a068-5ad97b821594 on hv-cinder-81558 Aug 05 10:48:02.037947 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-e18ee10a-10ae-4d22-afd1-9a7e4bac6934 req-ab0a6361-c045-4054-aaee-91adb326d111 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034212 Aug 05 10:48:02.038981 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 653/1281] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:48:02.723866 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-acf74076-280d-4e18-bde7-c0b768962aef tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:48:02.725141 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-acf74076-280d-4e18-bde7-c0b768962aef tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 635c0eba-edc3-43fc-a068-5ad97b821594] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:48:02.736799 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-acf74076-280d-4e18-bde7-c0b768962aef tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:02.737685 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-acf74076-280d-4e18-bde7-c0b768962aef tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:02.738393 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-acf74076-280d-4e18-bde7-c0b768962aef tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:02.739596 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-acf74076-280d-4e18-bde7-c0b768962aef tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:02.740162 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-acf74076-280d-4e18-bde7-c0b768962aef tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:02.740698 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-acf74076-280d-4e18-bde7-c0b768962aef tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:02.771575 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-acf74076-280d-4e18-bde7-c0b768962aef tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:02.772044 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-acf74076-280d-4e18-bde7-c0b768962aef tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:02.772476 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-acf74076-280d-4e18-bde7-c0b768962aef tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:02.772910 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.objects.instance [None req-acf74076-280d-4e18-bde7-c0b768962aef tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lazy-loading 'fault' on Instance uuid 635c0eba-edc3-43fc-a068-5ad97b821594 {{(pid=117831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 10:48:02.814234 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-acf74076-280d-4e18-bde7-c0b768962aef tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:48:02.822294 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-acf74076-280d-4e18-bde7-c0b768962aef tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594" status: 200 len: 1230 microversion: 2.1 time: 0.104894 Aug 05 10:48:02.822857 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 629/1282] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:48:02 2022] GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594 => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:48:03.849072 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-24cca919-fb83-4d86-81c4-b0a986997be8 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:48:03.849768 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-24cca919-fb83-4d86-81c4-b0a986997be8 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 635c0eba-edc3-43fc-a068-5ad97b821594] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:48:03.856727 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-24cca919-fb83-4d86-81c4-b0a986997be8 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:03.857201 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-24cca919-fb83-4d86-81c4-b0a986997be8 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:03.857633 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-24cca919-fb83-4d86-81c4-b0a986997be8 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:03.858318 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-24cca919-fb83-4d86-81c4-b0a986997be8 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:03.858763 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-24cca919-fb83-4d86-81c4-b0a986997be8 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:03.859215 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-24cca919-fb83-4d86-81c4-b0a986997be8 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:03.872730 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-24cca919-fb83-4d86-81c4-b0a986997be8 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] HTTP exception thrown: Instance 635c0eba-edc3-43fc-a068-5ad97b821594 could not be found. Aug 05 10:48:03.874296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-24cca919-fb83-4d86-81c4-b0a986997be8 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Request method failure captured: Aug 05 10:48:03.874296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594 HTTP/1.1 Aug 05 10:48:03.874296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:48:03.874296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:48:03.874296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:48:03.874296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:48:03.874296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:48:03.874296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:48:03.874296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:48:03.874296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:48:03.874296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7POZFyPpyqoE5xtedlrqJm7BhRjqbV-H8xq8zBKEX-42ITmlI2JqJZfhJ5dndOnOITqhLrKNr91y4t4vKMjwDl3L9-pCFcHAV6VD-L1dI1D9RSDVrIEF_pXCxxBKmkqS1w6CJNBlBPXQw3SfMWhQ9v5plEp_Ms9GRpK4rGOBNJJ5944 Aug 05 10:48:03.874296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:48:03.874296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:48:03.874296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:48:03.874296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:48:03.874296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:48:03.874296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:48:03.874296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 28cf7e20408a43c3bff9f70ad661d638 Aug 05 10:48:03.874296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-TestVolumeBootPattern-573262870 Aug 05 10:48:03.874296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:48:03.874296 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:48:03.876118 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_28cf7e20408a43c3bff9f70ad661d638"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/28cf7e20408a43c3bff9f70ad661d638"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/28cf7e20408a43c3bff9f70ad661d638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/28cf7e20408a43c3bff9f70ad661d638"}]}] Aug 05 10:48:03.876118 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-TestVolumeBootPattern-573262870 Aug 05 10:48:03.876118 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 28cf7e20408a43c3bff9f70ad661d638 Aug 05 10:48:03.876118 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-TestVolumeBootPattern-573262870 Aug 05 10:48:03.876118 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-TestVolumeBootPattern-573262870-project Aug 05 10:48:03.876118 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:48:03.876118 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:48:03.876118 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: c93e81531ea54583b11f5a6c107c9166 Aug 05 10:48:03.876118 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-TestVolumeBootPattern-573262870-project Aug 05 10:48:03.876118 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:48:03.876118 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Instance 635c0eba-edc3-43fc-a068-5ad97b821594 could not be found. Aug 05 10:48:03.876118 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': '635c0eba-edc3-43fc-a068-5ad97b821594'} Aug 05 10:48:03.877154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:48:03.877154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:48:03.877154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:48:03.877154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:48:03.877154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:48:03.877154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:48:03.877154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:48:03.877154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:48:03.877154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:48:03.877154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:48:03.877154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 635c0eba-edc3-43fc-a068-5ad97b821594 could not be found. Aug 05 10:48:03.877154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:48:03.877154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:48:03.877154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:48:03.877154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:48:03.877154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:48:03.877154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:48:03.877154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:48:03.877154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:48:03.877154 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:48:03.878958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:48:03.878958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:48:03.878958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:48:03.878958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:48:03.878958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:48:03.878958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:48:03.878958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:48:03.878958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 635c0eba-edc3-43fc-a068-5ad97b821594 could not be found. Aug 05 10:48:03.878958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:48:03.878958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:48:03.878958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:48:03.878958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:48:03.878958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:48:03.878958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:48:03.878958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:48:03.878958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:48:03.878958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 635c0eba-edc3-43fc-a068-5ad97b821594 could not be found. Aug 05 10:48:03.878958 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:48:03.880705 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-24cca919-fb83-4d86-81c4-b0a986997be8 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Returning 404 to user: Instance 635c0eba-edc3-43fc-a068-5ad97b821594 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:48:03.880705 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-24cca919-fb83-4d86-81c4-b0a986997be8 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594" status: 404 len: 111 microversion: 2.1 time: 0.034468 Aug 05 10:48:03.880705 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 654/1283] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:48:03 2022] GET /compute/v2.1/servers/635c0eba-edc3-43fc-a068-5ad97b821594 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:48:07.022090 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-c31cb327-e6d0-4a21-8e5b-26af5e1cb9ac tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:48:07.022714 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c31cb327-e6d0-4a21-8e5b-26af5e1cb9ac tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 0c898cc8-5c65-42eb-839e-4022a1dd965a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:48:07.024763 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-f6456b95-97c3-4fc8-bf26-e80a4e2c3554 req-59cd03cd-d5ed-431d-8af3-5d1769d2a369 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c898cc8-5c65-42eb-839e-4022a1dd965a", "tag": "eabd1b40-e101-4364-a3a5-8d15430db18b"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:48:07.029367 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c31cb327-e6d0-4a21-8e5b-26af5e1cb9ac tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:07.029847 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c31cb327-e6d0-4a21-8e5b-26af5e1cb9ac tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:07.030278 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c31cb327-e6d0-4a21-8e5b-26af5e1cb9ac tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:07.031021 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c31cb327-e6d0-4a21-8e5b-26af5e1cb9ac tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:07.031601 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c31cb327-e6d0-4a21-8e5b-26af5e1cb9ac tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:07.032023 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-c31cb327-e6d0-4a21-8e5b-26af5e1cb9ac tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:07.034878 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-f6456b95-97c3-4fc8-bf26-e80a4e2c3554 req-59cd03cd-d5ed-431d-8af3-5d1769d2a369 service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:07.035394 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-f6456b95-97c3-4fc8-bf26-e80a4e2c3554 req-59cd03cd-d5ed-431d-8af3-5d1769d2a369 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:07.035816 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-f6456b95-97c3-4fc8-bf26-e80a4e2c3554 req-59cd03cd-d5ed-431d-8af3-5d1769d2a369 service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:07.047849 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-f6456b95-97c3-4fc8-bf26-e80a4e2c3554 req-59cd03cd-d5ed-431d-8af3-5d1769d2a369 service nova] Creating event network-changed:eabd1b40-e101-4364-a3a5-8d15430db18b for instance 0c898cc8-5c65-42eb-839e-4022a1dd965a on hv-cinder-81558 Aug 05 10:48:07.052647 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-f6456b95-97c3-4fc8-bf26-e80a4e2c3554 req-59cd03cd-d5ed-431d-8af3-5d1769d2a369 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032386 Aug 05 10:48:07.053248 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 655/1284] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 10:48:07.060551 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-c31cb327-e6d0-4a21-8e5b-26af5e1cb9ac tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 0c898cc8-5c65-42eb-839e-4022a1dd965a] Going to try to terminate instance {{(pid=117831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 10:48:07.151604 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-c31cb327-e6d0-4a21-8e5b-26af5e1cb9ac tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a" status: 204 len: 0 microversion: 2.1 time: 0.133599 Aug 05 10:48:07.153208 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 630/1285] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:48:07 2022] DELETE /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 10:48:07.165020 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1d488ef4-78bd-48b4-9290-b6009855f43f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:48:07.166011 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1d488ef4-78bd-48b4-9290-b6009855f43f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 0c898cc8-5c65-42eb-839e-4022a1dd965a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:48:07.172876 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d488ef4-78bd-48b4-9290-b6009855f43f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:07.173576 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d488ef4-78bd-48b4-9290-b6009855f43f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:07.174194 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d488ef4-78bd-48b4-9290-b6009855f43f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:07.175105 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d488ef4-78bd-48b4-9290-b6009855f43f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:07.175751 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d488ef4-78bd-48b4-9290-b6009855f43f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:07.176176 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1d488ef4-78bd-48b4-9290-b6009855f43f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:07.317478 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1d488ef4-78bd-48b4-9290-b6009855f43f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:48:07.325360 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1d488ef4-78bd-48b4-9290-b6009855f43f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a" status: 200 len: 1579 microversion: 2.1 time: 0.167596 Aug 05 10:48:07.325928 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 656/1286] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:48:07 2022] GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a => generated 1579 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:48:08.347229 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-796fc349-4ddd-4317-9388-b50da7849c15 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:48:08.347911 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-796fc349-4ddd-4317-9388-b50da7849c15 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 0c898cc8-5c65-42eb-839e-4022a1dd965a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:48:08.355243 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-796fc349-4ddd-4317-9388-b50da7849c15 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:08.355728 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-796fc349-4ddd-4317-9388-b50da7849c15 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:08.356172 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-796fc349-4ddd-4317-9388-b50da7849c15 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:08.356866 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-796fc349-4ddd-4317-9388-b50da7849c15 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:08.357404 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-796fc349-4ddd-4317-9388-b50da7849c15 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:08.357739 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-796fc349-4ddd-4317-9388-b50da7849c15 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:08.553965 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-796fc349-4ddd-4317-9388-b50da7849c15 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:48:08.562415 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-796fc349-4ddd-4317-9388-b50da7849c15 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a" status: 200 len: 1579 microversion: 2.1 time: 0.219446 Aug 05 10:48:08.563000 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 631/1287] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:48:08 2022] GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a => generated 1579 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:48:09.442067 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-c7b2d2c5-827a-4e86-a8dc-ae23043a421f req-f6bd4c8e-7f93-45d6-b562-021d132813ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c898cc8-5c65-42eb-839e-4022a1dd965a", "name": "network-vif-deleted", "tag": "eabd1b40-e101-4364-a3a5-8d15430db18b"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 10:48:09.454780 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c7b2d2c5-827a-4e86-a8dc-ae23043a421f req-f6bd4c8e-7f93-45d6-b562-021d132813ee service nova] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:09.455282 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c7b2d2c5-827a-4e86-a8dc-ae23043a421f req-f6bd4c8e-7f93-45d6-b562-021d132813ee service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:09.455706 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c7b2d2c5-827a-4e86-a8dc-ae23043a421f req-f6bd4c8e-7f93-45d6-b562-021d132813ee service nova] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:09.470158 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-c7b2d2c5-827a-4e86-a8dc-ae23043a421f req-f6bd4c8e-7f93-45d6-b562-021d132813ee service nova] Creating event network-vif-deleted:eabd1b40-e101-4364-a3a5-8d15430db18b for instance 0c898cc8-5c65-42eb-839e-4022a1dd965a on hv-cinder-81558 Aug 05 10:48:09.475265 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-c7b2d2c5-827a-4e86-a8dc-ae23043a421f req-f6bd4c8e-7f93-45d6-b562-021d132813ee service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036977 Aug 05 10:48:09.476032 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 657/1288] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 5 10:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 10:48:09.582792 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-e09ade8c-65c9-4689-89de-30e7da93cdb1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:48:09.583404 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-e09ade8c-65c9-4689-89de-30e7da93cdb1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 0c898cc8-5c65-42eb-839e-4022a1dd965a] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:48:09.590705 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e09ade8c-65c9-4689-89de-30e7da93cdb1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:09.591228 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e09ade8c-65c9-4689-89de-30e7da93cdb1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:09.591661 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e09ade8c-65c9-4689-89de-30e7da93cdb1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:09.592356 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e09ade8c-65c9-4689-89de-30e7da93cdb1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:09.592843 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e09ade8c-65c9-4689-89de-30e7da93cdb1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:09.593259 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-e09ade8c-65c9-4689-89de-30e7da93cdb1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:09.662122 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.policy [None req-e09ade8c-65c9-4689-89de-30e7da93cdb1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93e81531ea54583b11f5a6c107c9166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cf7e20408a43c3bff9f70ad661d638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 10:48:09.671464 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-e09ade8c-65c9-4689-89de-30e7da93cdb1 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a" status: 200 len: 1226 microversion: 2.1 time: 0.092581 Aug 05 10:48:09.672042 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 632/1289] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:48:09 2022] GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 10:48:10.140321 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 10:48:10.140541 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Fri Aug 5 10:48:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 10:48:10.699143 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e67cbf63-b23d-4907-b1fd-d13a17f2e71f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:48:10.700281 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e67cbf63-b23d-4907-b1fd-d13a17f2e71f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 0c898cc8-5c65-42eb-839e-4022a1dd965a] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:48:10.710948 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e67cbf63-b23d-4907-b1fd-d13a17f2e71f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:10.711740 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e67cbf63-b23d-4907-b1fd-d13a17f2e71f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:10.712494 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e67cbf63-b23d-4907-b1fd-d13a17f2e71f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:10.713188 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e67cbf63-b23d-4907-b1fd-d13a17f2e71f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:10.713641 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e67cbf63-b23d-4907-b1fd-d13a17f2e71f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:10.714058 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e67cbf63-b23d-4907-b1fd-d13a17f2e71f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:10.727511 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-e67cbf63-b23d-4907-b1fd-d13a17f2e71f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] HTTP exception thrown: Instance 0c898cc8-5c65-42eb-839e-4022a1dd965a could not be found. Aug 05 10:48:10.729548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e67cbf63-b23d-4907-b1fd-d13a17f2e71f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Request method failure captured: Aug 05 10:48:10.729548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a HTTP/1.1 Aug 05 10:48:10.729548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:48:10.729548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:48:10.729548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:48:10.729548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:48:10.729548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:48:10.729548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:48:10.729548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:48:10.729548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:48:10.729548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7POZFyPpyqoE5xtedlrqJm7BhRjqbV-H8xq8zBKEX-42ITmlI2JqJZfhJ5dndOnOITqhLrKNr91y4t4vKMjwDl3L9-pCFcHAV6VD-L1dI1D9RSDVrIEF_pXCxxBKmkqS1w6CJNBlBPXQw3SfMWhQ9v5plEp_Ms9GRpK4rGOBNJJ5944 Aug 05 10:48:10.729548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:48:10.729548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:48:10.729548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:48:10.729548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:48:10.729548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:48:10.729548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:48:10.729548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 28cf7e20408a43c3bff9f70ad661d638 Aug 05 10:48:10.729548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-TestVolumeBootPattern-573262870 Aug 05 10:48:10.729548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:48:10.729548 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:48:10.731427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_28cf7e20408a43c3bff9f70ad661d638"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/28cf7e20408a43c3bff9f70ad661d638"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/28cf7e20408a43c3bff9f70ad661d638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/28cf7e20408a43c3bff9f70ad661d638"}]}] Aug 05 10:48:10.731427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-TestVolumeBootPattern-573262870 Aug 05 10:48:10.731427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 28cf7e20408a43c3bff9f70ad661d638 Aug 05 10:48:10.731427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-TestVolumeBootPattern-573262870 Aug 05 10:48:10.731427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-TestVolumeBootPattern-573262870-project Aug 05 10:48:10.731427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:48:10.731427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:48:10.731427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: c93e81531ea54583b11f5a6c107c9166 Aug 05 10:48:10.731427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-TestVolumeBootPattern-573262870-project Aug 05 10:48:10.731427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:48:10.731427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Instance 0c898cc8-5c65-42eb-839e-4022a1dd965a could not be found. Aug 05 10:48:10.731427 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': '0c898cc8-5c65-42eb-839e-4022a1dd965a'} Aug 05 10:48:10.732617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:48:10.732617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:48:10.732617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:48:10.732617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:48:10.732617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:48:10.732617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:48:10.732617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:48:10.732617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:48:10.732617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:48:10.732617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:48:10.732617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c898cc8-5c65-42eb-839e-4022a1dd965a could not be found. Aug 05 10:48:10.732617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:48:10.732617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:48:10.732617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:48:10.732617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:48:10.732617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:48:10.732617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:48:10.732617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:48:10.732617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:48:10.732617 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:48:10.734396 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:48:10.734396 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:48:10.734396 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:48:10.734396 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:48:10.734396 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:48:10.734396 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:48:10.734396 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:48:10.734396 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c898cc8-5c65-42eb-839e-4022a1dd965a could not be found. Aug 05 10:48:10.734396 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:48:10.734396 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:48:10.734396 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:48:10.734396 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:48:10.734396 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:48:10.734396 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:48:10.734396 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:48:10.734396 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:48:10.734396 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c898cc8-5c65-42eb-839e-4022a1dd965a could not be found. Aug 05 10:48:10.734396 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:48:10.736057 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e67cbf63-b23d-4907-b1fd-d13a17f2e71f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Returning 404 to user: Instance 0c898cc8-5c65-42eb-839e-4022a1dd965a could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:48:10.736057 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e67cbf63-b23d-4907-b1fd-d13a17f2e71f tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a" status: 404 len: 111 microversion: 2.1 time: 0.040034 Aug 05 10:48:10.736057 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 658/1290] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:48:10 2022] GET /compute/v2.1/servers/0c898cc8-5c65-42eb-839e-4022a1dd965a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:48:11.214440 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-cc92156f-fb43-4877-bd6c-07b5e43bba81 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:48:11.215046 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.compute.api [None req-cc92156f-fb43-4877-bd6c-07b5e43bba81 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] Fetching instance by UUID {{(pid=117831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:48:11.225534 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cc92156f-fb43-4877-bd6c-07b5e43bba81 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:11.226184 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cc92156f-fb43-4877-bd6c-07b5e43bba81 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:11.226710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cc92156f-fb43-4877-bd6c-07b5e43bba81 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:11.227835 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cc92156f-fb43-4877-bd6c-07b5e43bba81 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:11.228731 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cc92156f-fb43-4877-bd6c-07b5e43bba81 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:11.229532 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG oslo_concurrency.lockutils [None req-cc92156f-fb43-4877-bd6c-07b5e43bba81 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:11.243034 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.wsgi [None req-cc92156f-fb43-4877-bd6c-07b5e43bba81 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] HTTP exception thrown: Instance 9532b6a6-a794-4537-86b2-97bfe520ff7d could not be found. Aug 05 10:48:11.245161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-cc92156f-fb43-4877-bd6c-07b5e43bba81 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Request method failure captured: Aug 05 10:48:11.245161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: request: DELETE /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d HTTP/1.1 Aug 05 10:48:11.245161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept: application/json Aug 05 10:48:11.245161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Accept-Encoding: identity Aug 05 10:48:11.245161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Connection: close Aug 05 10:48:11.245161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Length: 0 Aug 05 10:48:11.245161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Content-Type: application/json Aug 05 10:48:11.245161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Host: 10.222.0.40 Aug 05 10:48:11.245161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Openstack-System-Scope: None Aug 05 10:48:11.245161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: User-Agent: python-urllib3/1.26.11 Aug 05 10:48:11.245161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Auth-Token: gAAAAABi7POZFyPpyqoE5xtedlrqJm7BhRjqbV-H8xq8zBKEX-42ITmlI2JqJZfhJ5dndOnOITqhLrKNr91y4t4vKMjwDl3L9-pCFcHAV6VD-L1dI1D9RSDVrIEF_pXCxxBKmkqS1w6CJNBlBPXQw3SfMWhQ9v5plEp_Ms9GRpK4rGOBNJJ5944 Aug 05 10:48:11.245161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Id: None Aug 05 10:48:11.245161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Domain-Name: None Aug 05 10:48:11.245161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Identity-Status: Confirmed Aug 05 10:48:11.245161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Is-Admin-Project: True Aug 05 10:48:11.245161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Id: default Aug 05 10:48:11.245161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Domain-Name: Default Aug 05 10:48:11.245161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Id: 28cf7e20408a43c3bff9f70ad661d638 Aug 05 10:48:11.245161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Project-Name: tempest-TestVolumeBootPattern-573262870 Aug 05 10:48:11.245161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Role: member,reader Aug 05 10:48:11.245161 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Roles: member,reader Aug 05 10:48:11.246819 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_28cf7e20408a43c3bff9f70ad661d638"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/28cf7e20408a43c3bff9f70ad661d638"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/28cf7e20408a43c3bff9f70ad661d638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/28cf7e20408a43c3bff9f70ad661d638"}]}] Aug 05 10:48:11.246819 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant: tempest-TestVolumeBootPattern-573262870 Aug 05 10:48:11.246819 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Id: 28cf7e20408a43c3bff9f70ad661d638 Aug 05 10:48:11.246819 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-Tenant-Name: tempest-TestVolumeBootPattern-573262870 Aug 05 10:48:11.246819 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User: tempest-TestVolumeBootPattern-573262870-project Aug 05 10:48:11.246819 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Id: default Aug 05 10:48:11.246819 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Domain-Name: Default Aug 05 10:48:11.246819 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Id: c93e81531ea54583b11f5a6c107c9166 Aug 05 10:48:11.246819 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: X-User-Name: tempest-TestVolumeBootPattern-573262870-project Aug 05 10:48:11.246819 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: method: > Aug 05 10:48:11.246819 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: exception: Instance 9532b6a6-a794-4537-86b2-97bfe520ff7d could not be found. Aug 05 10:48:11.246819 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: action_args: {'id': '9532b6a6-a794-4537-86b2-97bfe520ff7d'} Aug 05 10:48:11.247710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:48:11.247710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:48:11.247710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:48:11.247710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:48:11.247710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:48:11.247710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:48:11.247710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:48:11.247710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:48:11.247710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:48:11.247710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:48:11.247710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9532b6a6-a794-4537-86b2-97bfe520ff7d could not be found. Aug 05 10:48:11.247710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:48:11.247710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:48:11.247710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:48:11.247710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:48:11.247710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:48:11.247710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:48:11.247710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:48:11.247710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:48:11.247710 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:48:11.249091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:48:11.249091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 10:48:11.249091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 10:48:11.249091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 10:48:11.249091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 10:48:11.249091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:48:11.249091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:48:11.249091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:48:11.249091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:48:11.249091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9532b6a6-a794-4537-86b2-97bfe520ff7d could not be found. Aug 05 10:48:11.249091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:48:11.249091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:48:11.249091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:48:11.249091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:48:11.249091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:48:11.249091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:48:11.249091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:48:11.249091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:48:11.249091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9532b6a6-a794-4537-86b2-97bfe520ff7d could not be found. Aug 05 10:48:11.249091 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: ERROR nova.api.openstack.wsgi Aug 05 10:48:11.250515 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-cc92156f-fb43-4877-bd6c-07b5e43bba81 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Returning 404 to user: Instance 9532b6a6-a794-4537-86b2-97bfe520ff7d could not be found. {{(pid=117831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:48:11.250515 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-cc92156f-fb43-4877-bd6c-07b5e43bba81 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d" status: 404 len: 111 microversion: 2.1 time: 0.039112 Aug 05 10:48:11.250515 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 633/1291] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 5 10:48:11 2022] DELETE /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:48:11.257841 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a9aaf55b-7758-46fd-b101-bf689d11adad tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:48:11.258811 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a9aaf55b-7758-46fd-b101-bf689d11adad tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] [instance: 9532b6a6-a794-4537-86b2-97bfe520ff7d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 10:48:11.265036 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9aaf55b-7758-46fd-b101-bf689d11adad tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:11.265519 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9aaf55b-7758-46fd-b101-bf689d11adad tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:11.265939 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9aaf55b-7758-46fd-b101-bf689d11adad tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:11.266643 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9aaf55b-7758-46fd-b101-bf689d11adad tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Acquiring lock "f636a431-9fc7-40b9-b93c-769f38c3c626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 10:48:11.267134 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9aaf55b-7758-46fd-b101-bf689d11adad tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 10:48:11.267557 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9aaf55b-7758-46fd-b101-bf689d11adad tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Lock "f636a431-9fc7-40b9-b93c-769f38c3c626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 10:48:11.281499 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-a9aaf55b-7758-46fd-b101-bf689d11adad tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] HTTP exception thrown: Instance 9532b6a6-a794-4537-86b2-97bfe520ff7d could not be found. Aug 05 10:48:11.283049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a9aaf55b-7758-46fd-b101-bf689d11adad tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Request method failure captured: Aug 05 10:48:11.283049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d HTTP/1.1 Aug 05 10:48:11.283049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept: application/json Aug 05 10:48:11.283049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Aug 05 10:48:11.283049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Connection: close Aug 05 10:48:11.283049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Length: 0 Aug 05 10:48:11.283049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Content-Type: application/json Aug 05 10:48:11.283049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Host: 10.222.0.40 Aug 05 10:48:11.283049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Aug 05 10:48:11.283049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.11 Aug 05 10:48:11.283049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABi7POZFyPpyqoE5xtedlrqJm7BhRjqbV-H8xq8zBKEX-42ITmlI2JqJZfhJ5dndOnOITqhLrKNr91y4t4vKMjwDl3L9-pCFcHAV6VD-L1dI1D9RSDVrIEF_pXCxxBKmkqS1w6CJNBlBPXQw3SfMWhQ9v5plEp_Ms9GRpK4rGOBNJJ5944 Aug 05 10:48:11.283049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Aug 05 10:48:11.283049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Aug 05 10:48:11.283049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Aug 05 10:48:11.283049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Aug 05 10:48:11.283049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Aug 05 10:48:11.283049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Aug 05 10:48:11.283049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Id: 28cf7e20408a43c3bff9f70ad661d638 Aug 05 10:48:11.283049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-TestVolumeBootPattern-573262870 Aug 05 10:48:11.283049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Role: member,reader Aug 05 10:48:11.283049 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Aug 05 10:48:11.284856 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_28cf7e20408a43c3bff9f70ad661d638"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/28cf7e20408a43c3bff9f70ad661d638"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/28cf7e20408a43c3bff9f70ad661d638"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/28cf7e20408a43c3bff9f70ad661d638"}]}] Aug 05 10:48:11.284856 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-TestVolumeBootPattern-573262870 Aug 05 10:48:11.284856 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 28cf7e20408a43c3bff9f70ad661d638 Aug 05 10:48:11.284856 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-TestVolumeBootPattern-573262870 Aug 05 10:48:11.284856 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User: tempest-TestVolumeBootPattern-573262870-project Aug 05 10:48:11.284856 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Aug 05 10:48:11.284856 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Aug 05 10:48:11.284856 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Id: c93e81531ea54583b11f5a6c107c9166 Aug 05 10:48:11.284856 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-TestVolumeBootPattern-573262870-project Aug 05 10:48:11.284856 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: method: > Aug 05 10:48:11.284856 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: exception: Instance 9532b6a6-a794-4537-86b2-97bfe520ff7d could not be found. Aug 05 10:48:11.284856 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: action_args: {'id': '9532b6a6-a794-4537-86b2-97bfe520ff7d'} Aug 05 10:48:11.285866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 10:48:11.285866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:48:11.285866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 10:48:11.285866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 10:48:11.285866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 10:48:11.285866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 10:48:11.285866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 10:48:11.285866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 10:48:11.285866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 10:48:11.285866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 10:48:11.285866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9532b6a6-a794-4537-86b2-97bfe520ff7d could not be found. Aug 05 10:48:11.285866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:48:11.285866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:48:11.285866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:48:11.285866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:48:11.285866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:48:11.285866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:48:11.285866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 10:48:11.285866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 10:48:11.285866 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 10:48:11.287592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 10:48:11.287592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 10:48:11.287592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 10:48:11.287592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 10:48:11.287592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 10:48:11.287592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 10:48:11.287592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 10:48:11.287592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9532b6a6-a794-4537-86b2-97bfe520ff7d could not be found. Aug 05 10:48:11.287592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:48:11.287592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 10:48:11.287592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:48:11.287592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 10:48:11.287592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 10:48:11.287592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 10:48:11.287592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 10:48:11.287592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 10:48:11.287592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9532b6a6-a794-4537-86b2-97bfe520ff7d could not be found. Aug 05 10:48:11.287592 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Aug 05 10:48:11.289091 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a9aaf55b-7758-46fd-b101-bf689d11adad tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Returning 404 to user: Instance 9532b6a6-a794-4537-86b2-97bfe520ff7d could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 10:48:11.289091 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a9aaf55b-7758-46fd-b101-bf689d11adad tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d" status: 404 len: 111 microversion: 2.1 time: 0.032781 Aug 05 10:48:11.289091 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 659/1292] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 5 10:48:11 2022] GET /compute/v2.1/servers/9532b6a6-a794-4537-86b2-97bfe520ff7d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 10:48:12.612999 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: DEBUG nova.api.openstack.wsgi [None req-ec585a14-2e9c-42bc-83fe-2037314ed8b8 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] Calling method '.version_select at 0x7f732fd2daf0>' {{(pid=117831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 10:48:12.645825 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO nova.api.openstack.requestlog [None req-ec585a14-2e9c-42bc-83fe-2037314ed8b8 tempest-TestVolumeBootPattern-573262870 tempest-TestVolumeBootPattern-573262870-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1855561432" status: 202 len: 0 microversion: 2.1 time: 0.036762 Aug 05 10:48:12.646793 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: [pid: 117831|app: 0|req: 634/1293] 10.222.0.40 () {58 vars in 1263 bytes} [Fri Aug 5 10:48:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1855561432 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 10:49:34.028674 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 10:49:34.029613 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Fri Aug 5 10:49:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 10:49:43.541473 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 10:49:43.542265 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Fri Aug 5 10:49:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 10:51:27.908325 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 10:51:27.908895 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Fri Aug 5 10:51:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 10:51:30.151788 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 10:51:30.152810 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Fri Aug 5 10:51:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 10:52:54.041821 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 10:52:54.042643 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Fri Aug 5 10:52:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 10:53:03.553828 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 10:53:03.554781 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Fri Aug 5 10:53:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 10:53:25.063279 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 10:53:25.064324 dv-cinder-815582-15-iscsi devstack@n-api.service[117831]: Fri Aug 5 10:53:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 10:53:27.634781 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 10:53:27.635752 dv-cinder-815582-15-iscsi devstack@n-api.service[117832]: Fri Aug 5 10:53:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!